-- Logs begin at Fri 2022-07-15 18:41:59 UTC, end at Fri 2022-07-15 19:53:19 UTC. -- Jul 15 19:16:06.931689 dv-cinder-849690-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 19:16:06.940232 dv-cinder-849690-2-smb devstack@keystone.service[80216]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 19:16:06 2022] *** Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: nodename: dv-cinder-849690-2-smb Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: machine: x86_64 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: clock source: unix Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: pcre jit disabled Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: detected number of CPU cores: 4 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: current working directory: / Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: detected binary path: /usr/bin/uwsgi-core Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: your processes number limit is 47680 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: your memory page size is 4096 bytes Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: detected max file descriptor number: 2048 Jul 15 19:16:06.942323 dv-cinder-849690-2-smb devstack@keystone.service[80216]: lock engine: pthread robust mutexes Jul 15 19:16:06.943197 dv-cinder-849690-2-smb devstack@keystone.service[80216]: thunder lock: enabled Jul 15 19:16:06.943197 dv-cinder-849690-2-smb devstack@keystone.service[80216]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 19:16:06.943197 dv-cinder-849690-2-smb devstack@keystone.service[80216]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 19:16:06.982324 dv-cinder-849690-2-smb devstack@keystone.service[80216]: Python main interpreter initialized at 0x561378d0c9c0 Jul 15 19:16:06.982324 dv-cinder-849690-2-smb devstack@keystone.service[80216]: python threads support enabled Jul 15 19:16:06.982324 dv-cinder-849690-2-smb devstack@keystone.service[80216]: your server socket listen backlog is limited to 100 connections Jul 15 19:16:06.982324 dv-cinder-849690-2-smb devstack@keystone.service[80216]: your mercy for graceful operations on workers is 90 seconds Jul 15 19:16:06.982682 dv-cinder-849690-2-smb devstack@keystone.service[80216]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 19:16:06.982754 dv-cinder-849690-2-smb devstack@keystone.service[80216]: *** Operational MODE: preforking *** Jul 15 19:16:06.983049 dv-cinder-849690-2-smb devstack@keystone.service[80216]: *** uWSGI is running in multiple interpreter mode *** Jul 15 19:16:06.983049 dv-cinder-849690-2-smb devstack@keystone.service[80216]: spawned uWSGI master process (pid: 80216) Jul 15 19:16:06.983267 dv-cinder-849690-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 15 19:16:06.985753 dv-cinder-849690-2-smb devstack@keystone.service[80216]: spawned uWSGI worker 1 (pid: 80224, cores: 1) Jul 15 19:16:06.985753 dv-cinder-849690-2-smb devstack@keystone.service[80216]: spawned uWSGI worker 2 (pid: 80225, cores: 1) Jul 15 19:16:06.985753 dv-cinder-849690-2-smb devstack@keystone.service[80216]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 19:16:12.327504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:16:12.327504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 15 19:16:12.328329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:16:12.328329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: from cryptography.utils import int_from_bytes Jul 15 19:16:12.328329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:16:12.328329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: from cryptography.utils import int_from_bytes Jul 15 19:16:12.328814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:16:12.328814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 15 19:16:12.376640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 19:16:12.376838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 19:16:12.376914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 19:16:12.376987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] command line args: [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 19:16:12.377053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 19:16:12.377190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] command line args: [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 19:16:12.377280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 19:16:12.377392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ================================================================================ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 19:16:12.377468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 19:16:12.377618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ================================================================================ {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 19:16:12.377705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.377893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] admin_token = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_dir = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] config_dir = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_source = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] debug = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] config_source = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] debug = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.378895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.379994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_config_append = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_config_append = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_dir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_dir = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_file = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.380929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.381967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.382879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.383993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] publish_errors = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] publish_errors = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.384968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.385978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] standard_threads = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] standard_threads = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] use_journal = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_journal = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.386962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] use_json = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_json = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] use_stderr = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_stderr = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_syslog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] use_syslog = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:16:12.387782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.387857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.388998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.389989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.390969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.391933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.392988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.393968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.394924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.395875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.396994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.397979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.398854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.399858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.400923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.401874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.402878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.403904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.404939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.405941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.406702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.412849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.413959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.414956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.415938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.416999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.external = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.417961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.password = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.token = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.418908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.external = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.419984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.password = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] auth.token = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.420960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.421987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.422953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.423924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.424968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.425973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.426956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.427930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.428958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.429198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.429303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.429527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.429700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.429967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.430992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.431976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.432899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.433965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.434876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.435186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.435311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.435494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.435714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.435855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.436827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.437976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.438975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.439987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.440965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.441940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.442958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.443901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.444879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.445989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.446979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.447982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.448951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.449894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.450867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.451827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.452848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.453963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.454987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.455986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.456517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] role.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.456603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.456836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] role.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.456988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.457974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.458935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.459929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.460909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.461899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.462890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.463995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.464954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.465910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.466986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.467906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.468929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.connection = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.469948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.470886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.471916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 19:16:12.472913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.472913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.473260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.473389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.473552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.473852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:16:12.474066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 19:16:12.502926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.503197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.503396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.503920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.504153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.504379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.511780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.512796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.539891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.540116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.540729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.540990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.684887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.685461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.733110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.733402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.734092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.734329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.797876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.798038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.798158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.798316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.823958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.824691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.836214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.836338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.849999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.850576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:16:12.867649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.867836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:16:12.868077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.868290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:16:12.868424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.868586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:16:12.868847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.868971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:16:12.869110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.869838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.870067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.880415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.880695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.880950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.881073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.881216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.881326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.881454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.881757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.889544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.890088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.892903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.893187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.893379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.893505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.893646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.893751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.893957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.894903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.895861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.896066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.922295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.922549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.923948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.924198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.924342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.924525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.929475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.929712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.929795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.930009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.930149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.930285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.937535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.937725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.937824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.938038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.942256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.942534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.942659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.942801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.942942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.943942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.944155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.944277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.944424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.963274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.963522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.963620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.963901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.968097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.968518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.971909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.972183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.972304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.972595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.977333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.977729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.980965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.981376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:12.984699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.984994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.985910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.986061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.986189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:12.986424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.005214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.005491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.005613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.005762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.005917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.006003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.006132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.006320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.013916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.014234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.015677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.015903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.016001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.016293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.019124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.019412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.019533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.019694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.019821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.019944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.020079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.020216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.020338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.020572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.033664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.033906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.033993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.034173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.034262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.034481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.034672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.034769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.034927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.035050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.035170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.035302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.035468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.035606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.054449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.054836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.057720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.058108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.061043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.061479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.062708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.063121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.064498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.064773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.064894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.065052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.065200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.065417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.072362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.072698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.073949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.074303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.077322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.077604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.077728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.077935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.078058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.078190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.078328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.078452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.087759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.088042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.088163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.088324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.088457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.088579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.096219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.096496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.096686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:16:13.096782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.096904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.097933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.098945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.099879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.100000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:16:13.142016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561378d0c9c0 pid: 80224 (default app) Jul 15 19:16:13.142809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561378d0c9c0 pid: 80225 (default app) Jul 15 19:16:13.145513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf08d7-1d9e-4fb5-b409-2d618bf3b664 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:13.145809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf08d7-1d9e-4fb5-b409-2d618bf3b664 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:13.146090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf08d7-1d9e-4fb5-b409-2d618bf3b664 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:13.150383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Fri Jul 15 19:16:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.699816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.700743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.700743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.708286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:20.714682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.715163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.715289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.784645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: INFO dbcounter [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] Registered counter for database keystone Jul 15 19:16:20.809321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG oslo_db.sqlalchemy.engines [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 19:16:20.817536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writer thread running {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 19:16:20.996703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80224) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 19:16:20.997032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80224) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 19:16:21.051663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:21.053296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:21.181736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 19:16:21.388823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.464198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: INFO dbcounter [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] Registered counter for database keystone Jul 15 19:16:21.485688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG oslo_db.sqlalchemy.engines [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 19:16:21.499854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writer thread running {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 19:16:21.618636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e90c-d202-4115-a9d8-37fe0df8c41f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.624188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.624857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.625150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.625426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.634661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.685969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 19:16:21.686278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf48d-ce42-4298-8388-05c0beffd4df admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.696656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:16:21.705071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.720243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00287d-6ff3-4dfc-8f0f-2b5fab7260b3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.725257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.726419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.726709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.727014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] PATH_INFO: `/v3/projects/1d82d6637d8c4815a3aaa31f204adffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.728596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d82d6637d8c4815a3aaa31f204adffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.781212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 19:16:21.781554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729765-6f30-4464-a092-e5f0c9e65164 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.786264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/projects/1d82d6637d8c4815a3aaa31f204adffe => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:23.755043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017934-f117-4c7d-8a1b-5913eb7591c3 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.755611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017934-f117-4c7d-8a1b-5913eb7591c3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.755611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017934-f117-4c7d-8a1b-5913eb7591c3 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.759784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:23.766565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.767338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.767473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.790773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:23.792425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:23.801638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 19:16:23.823825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017934-f117-4c7d-8a1b-5913eb7591c3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.840186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017934-f117-4c7d-8a1b-5913eb7591c3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:23.847248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.847896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.848175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.848445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.857396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.859342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afbc54-c620-492e-a20f-f803535fbd5e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.868731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:16:23.874297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.883911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b07c-4e73-4c6f-b6cf-4e72e8dfc25f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:23.889727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.890612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.890927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.891200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.892836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.894702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351826b-4c0d-42fe-9a4d-ca6260a44eed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.896317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:25.922971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a05-5965-416c-b1ad-84c99c542ed3 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.923504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a05-5965-416c-b1ad-84c99c542ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.923504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a05-5965-416c-b1ad-84c99c542ed3 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.924883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:25.930303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.930765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.930893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.949265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:25.950483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:25.971137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1500cb-d8af-48ed-aeac-f8cdac8e48a9 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.971472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1500cb-d8af-48ed-aeac-f8cdac8e48a9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.971847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1500cb-d8af-48ed-aeac-f8cdac8e48a9 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.973810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:25.978815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.979113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.979399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.025490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG passlib.handlers.bcrypt [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80225) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 19:16:26.025915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG passlib.handlers.bcrypt [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80225) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 19:16:26.045375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:26.068255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.071190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:26.072806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:26.093476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.171764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:26.176008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ae29a-3879-4cbb-8f80-ad41ca7d7c9b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.193138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.210421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.211277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.211557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.211833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.223080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:26.234505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.235521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:26.236304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:26.241953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.297056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5118-3749-4abc-98fa-b2b352ac3787 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.299375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.325616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.334876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.335796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.336083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.336359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.345774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7d87-9966-4956-9c37-e758228c1e5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.381195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.381866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.382148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.382423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.383217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.383532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.384945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.396727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:26.402575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.402701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.404142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.502797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:16:26.504292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964da9c-3295-4f9c-b943-e5dfbf0649a2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.508580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.511346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.539402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.540298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.540577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.540849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.542089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.543644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.545319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:26.550749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.565514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.609599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b43-18c0-49f6-ab37-cba12ef160ea None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.642760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.643601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.643899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.644229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.648628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974202-b4f1-4eb7-a6d9-7201e03cc1b0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.664238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.665761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:26.686296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.687197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.688200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:26.688200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:26.688200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.688200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:26.688200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.688469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.688945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.689217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.689497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.690693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.692190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.693323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.693789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:26.699480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.752698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.781166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.798018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae983-179e-4c01-b1b7-9cbfd75c0b97 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.804201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c55a8e-b10b-4664-8a6b-d2db6543f0ae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.832860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.833550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.833831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.834113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.834885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.835196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.836607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcd520-ad4f-4b15-84b3-f5131e91a3dd None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.838286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.838987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.839282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.839613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.840462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.domain.id=default, user.id=72ba3f2f992c417989b7e2463df4d263) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.840791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.842321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f44214-41d5-41a9-a449-b31f79382566 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.849057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/role_assignments?user.id=72ba3f2f992c417989b7e2463df4d263&scope.domain.id=default&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:26.854136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:29.357767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a957e-3448-4e41-a65f-b1da6f6c67e3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.358363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a957e-3448-4e41-a65f-b1da6f6c67e3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.358363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a957e-3448-4e41-a65f-b1da6f6c67e3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.359781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:29.365395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc43178-3076-4b6a-91d2-e64b0fadab0a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.366172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc43178-3076-4b6a-91d2-e64b0fadab0a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.366638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc43178-3076-4b6a-91d2-e64b0fadab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.391476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ddc43178-3076-4b6a-91d2-e64b0fadab0a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:29.393039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ddc43178-3076-4b6a-91d2-e64b0fadab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:29.472989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:29.480430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa836-60e4-40e4-be70-78c54a4717cb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.480793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa836-60e4-40e4-be70-78c54a4717cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.481140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa836-60e4-40e4-be70-78c54a4717cb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.482765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:29.488197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705143a7-dac6-4054-87d2-16f3a1f9efc9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.488672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705143a7-dac6-4054-87d2-16f3a1f9efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.489118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705143a7-dac6-4054-87d2-16f3a1f9efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.505169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa836-60e4-40e4-be70-78c54a4717cb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.515304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-705143a7-dac6-4054-87d2-16f3a1f9efc9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:29.517687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-705143a7-dac6-4054-87d2-16f3a1f9efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:29.601421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.634176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:29.635404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8cc7-88e8-4d8e-b59c-ccbdd014668d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.635700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8cc7-88e8-4d8e-b59c-ccbdd014668d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.635994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8cc7-88e8-4d8e-b59c-ccbdd014668d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.637383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 13/26] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:29.638313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514a4f-378a-4728-afa0-e6a91ecebe3b None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.638599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514a4f-378a-4728-afa0-e6a91ecebe3b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.638903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514a4f-378a-4728-afa0-e6a91ecebe3b None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.640321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:29.652130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f187d-6aa0-4d3e-9406-4a08cdde14f1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.652419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f187d-6aa0-4d3e-9406-4a08cdde14f1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.652702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f187d-6aa0-4d3e-9406-4a08cdde14f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.675616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e27f187d-6aa0-4d3e-9406-4a08cdde14f1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:29.677112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e27f187d-6aa0-4d3e-9406-4a08cdde14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:29.713014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa836-60e4-40e4-be70-78c54a4717cb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.756673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.757466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.757750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.758028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.759238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:29.761395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.761878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.762331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.769204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:29.778864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:29.779892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:29.780943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 14/29] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:29.781729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.783811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:29.786241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.788246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:29.884360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:29.890538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.926915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6178-e7f9-46ac-8836-07fd63b149eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.936183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.974672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.976548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.977038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.977482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.978483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.980175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.010108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a762ef-e6c2-4a07-ac23-8c9684f0dbfa None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.046442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.047256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.047706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.048133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.049007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.049413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.051008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.066773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 17/31] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.067876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.143001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 15/32] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:30.145277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.176651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.181843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de11b-7d54-4084-a729-0d864131a81d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.221794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.222638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.223026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.223368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.224202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.225675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.242814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.321311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628695b2-f6a3-44ce-8eae-2dd7b07e4626 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.379460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.380299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.380584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.380861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.383299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 18/33] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Jul 15 19:16:30 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:30.384467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.393492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.395208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:30.414908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:30.415759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:30.416526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:30.416526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:30.416526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:30.416526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:30.416526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 16/34] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:30.423084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.501392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ecc-6449-4b02-80df-ad5f49c177fe None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.542261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.543236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.543525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.543810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.545925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.547692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798498-71b7-42f0-a36b-80401c6628bc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.549594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b249e-b824-486b-b700-ae3b74f9e32a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.549843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 19/35] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.551247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0b99-3083-4e67-94fc-7e1a87835bfd None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.551537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0b99-3083-4e67-94fc-7e1a87835bfd None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.551817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0b99-3083-4e67-94fc-7e1a87835bfd None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.553288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 20/36] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:30.558150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f0b99-3083-4e67-94fc-7e1a87835bfd None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.573632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.594317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.596929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.599249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.599249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.599249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.599677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.600204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.602124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5a646-611e-4b35-b24e-19692f02ea1f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.625976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 17/37] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:30.627770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.628198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.628661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.647487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:30.649305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:30.688133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f0b99-3083-4e67-94fc-7e1a87835bfd None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.731059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.731884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.732172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.732443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.734111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.735803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.737935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 21/38] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.738694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.744802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:30.745883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.846672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.854025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608119-7ffb-47be-ab41-2853e8dd7614 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.869648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915646b-b958-4dfe-be0d-0ed33754b9fc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.887710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.888391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.888677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.888987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.889817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.891384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.923092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 22/40] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:30 2022] POST /identity/v3/projects => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:30.923852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.991323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.025181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.026097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.026386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.026669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] PATH_INFO: `/v3/domains/default/users/72ba3f2f992c417989b7e2463df4d263/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.028902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=72ba3f2f992c417989b7e2463df4d263, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.030830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b0f7e-a2f8-403d-8c48-2248fb97daf4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.050433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 19/41] 10.222.0.57 () {58 vars in 1361 bytes} [Fri Jul 15 19:16:30 2022] PUT /identity/v3/domains/default/users/72ba3f2f992c417989b7e2463df4d263/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:31.052498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b051-3d34-4cb6-b5c1-f14d34607a1f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.052793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b051-3d34-4cb6-b5c1-f14d34607a1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.053075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132b051-3d34-4cb6-b5c1-f14d34607a1f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.059349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 20/42] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:31.062693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.063227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.063746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.075592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0f8d-6ad8-4884-9dfa-0cdf761794f5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.089622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:31.091603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:31.117337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.118042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.118328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.118614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.119420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.120872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.139799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 23/43] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Jul 15 19:16:30 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:31.185433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 21/44] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:31.210331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.220870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.322951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ab2cd-7fdb-4404-92db-093ab0b73760 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.363665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.364493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.364775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.365051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.366242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.367791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471177b-e06c-4d0e-b89a-205fe87491d6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.369456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 24/45] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:31.375351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.471120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.477694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2d6c-6025-4bd0-90cb-efbbf2b765b4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.513824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.514591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.514910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.515193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.515924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.517390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1a24b-5455-4dd7-a30e-b35da56175a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.546427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 22/46] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:31 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:33.071952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b977e7-4ed3-45c7-bd35-360358676899 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.072438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b977e7-4ed3-45c7-bd35-360358676899 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.072438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b977e7-4ed3-45c7-bd35-360358676899 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.073870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 25/47] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:33.079491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.079926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.080020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.098219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:33.099489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:33.170675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 23/48] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:33.193323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b977e7-4ed3-45c7-bd35-360358676899 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.272438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.299916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b977e7-4ed3-45c7-bd35-360358676899 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.334862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.335601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.335882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.336155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.347783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-15b572f7-3138-473c-ad23-9c0edaa5b63e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:33.356716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:33.357707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:33.358529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 26/49] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:33.364084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.446679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.471752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009215d7-966e-4a1c-a556-2d0093167316 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.506424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.507144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.507430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.507712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.508472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.508783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.510199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.520379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 24/50] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:33.524743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fcf78-874f-49df-b2dd-dfaab7146980 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.525141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fcf78-874f-49df-b2dd-dfaab7146980 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.525431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fcf78-874f-49df-b2dd-dfaab7146980 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.526095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.526827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 27/51] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:33.531881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.532169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.532446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.550355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:33.551999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:33.636117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c51e-3dcc-46bd-8896-eb161bba70d8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.674852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.675799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.676087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.676374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.677712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.679260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.680983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 25/52] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:33.686909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.698347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.731390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 28/53] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:33.753817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.788347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953379af-1e0e-49d8-b34c-aa670a5e5c5a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.817745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.824944 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.825762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.826038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.826315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.827590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.829046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.830664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 26/54] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.836874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.857574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf425f6-a05e-4775-aca8-9e94368ac093 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.891496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.892244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.892532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.892809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.894059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.895584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.897233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 29/55] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.903008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.915617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.941237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972339-c596-41ca-9e10-5b84482ead89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.974668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.975355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.975636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.975911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.976742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.domain.id=default, user.id=72ba3f2f992c417989b7e2463df4d263) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.977049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.978494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedca5a-319a-4ced-aaf1-e6f689571573 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.984251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 27/56] 10.222.0.57 () {56 vars in 1322 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/role_assignments?user.id=72ba3f2f992c417989b7e2463df4d263&scope.domain.id=default&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:34.005749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5a1b-1325-4416-aced-3d6747858a13 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.038904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.045758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.046454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.046744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.047050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.047776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.049264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9999-885e-4649-a82c-c251230594d9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.080369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 30/57] 10.222.0.57 () {60 vars in 1140 bytes} [Fri Jul 15 19:16:33 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:16:36.072711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0a0f-9f35-4350-9447-822e55eb7a08 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.073216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0a0f-9f35-4350-9447-822e55eb7a08 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.073216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0a0f-9f35-4350-9447-822e55eb7a08 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.074599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 28/58] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:36.081523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.082165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.082458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.109977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:36.111215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:36.181227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:36.213728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0a0f-9f35-4350-9447-822e55eb7a08 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.320062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0a0f-9f35-4350-9447-822e55eb7a08 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.358151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.358922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.359210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.359489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.360770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.362249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaf5cd-8fdc-4147-8c8e-a92115d72b7c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.363907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 29/60] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.369674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.470652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19dc35-b943-4449-9e20-c2fe564c1345 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.485015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.506245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.506946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.507233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.507511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.508236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.509724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058a98-b40d-4856-bd7b-4b38a9ac7f96 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.537862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 32/61] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:36 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:39.569467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9735d-c894-4c4a-8fd2-45dd41385e7c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.569982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9735d-c894-4c4a-8fd2-45dd41385e7c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.570091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9735d-c894-4c4a-8fd2-45dd41385e7c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.571430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 30/62] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:39.577025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c53130-877a-4509-a4cc-6e0b96088b28 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.577887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c53130-877a-4509-a4cc-6e0b96088b28 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.578361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c53130-877a-4509-a4cc-6e0b96088b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.607786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-89c53130-877a-4509-a4cc-6e0b96088b28 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:39.609336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-89c53130-877a-4509-a4cc-6e0b96088b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:39.708154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 33/63] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:39.734549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9735d-c894-4c4a-8fd2-45dd41385e7c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.750854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.808044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d792-9bf4-42b3-8fb6-fd1217fd6bbf None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.808740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d792-9bf4-42b3-8fb6-fd1217fd6bbf None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.809211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d792-9bf4-42b3-8fb6-fd1217fd6bbf None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.811683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 34/64] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:39.818922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b42a-007c-49ce-8b71-cc97adb4f23e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.819679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b42a-007c-49ce-8b71-cc97adb4f23e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.820157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b42a-007c-49ce-8b71-cc97adb4f23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.847849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3541b42a-007c-49ce-8b71-cc97adb4f23e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:39.849067 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3541b42a-007c-49ce-8b71-cc97adb4f23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:39.865863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9735d-c894-4c4a-8fd2-45dd41385e7c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.904850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.905674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.905954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.906226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.917973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:39.926493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:39.927341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:39.928071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 31/65] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:39.934038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.014345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:40.022264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d99cc-e831-4c1c-9f2f-c0927ead1ef8 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.022554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d99cc-e831-4c1c-9f2f-c0927ead1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.023101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d99cc-e831-4c1c-9f2f-c0927ead1ef8 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.024655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 36/67] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:40.031136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.034180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db9a7-5070-46d4-b094-9e80cb34758e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.034473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db9a7-5070-46d4-b094-9e80cb34758e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.034752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db9a7-5070-46d4-b094-9e80cb34758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.059927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a48db9a7-5070-46d4-b094-9e80cb34758e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:40.061623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a48db9a7-5070-46d4-b094-9e80cb34758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:40.070268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4ad1-e6e2-4ce3-8873-76b84894521b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.088656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.108859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.109549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.109832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.110107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.110903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.111220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.112641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.121065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 32/68] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:40.121950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.139532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:40.141133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7904-2136-49e0-8e62-54ee0e8f9a86 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.141582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7904-2136-49e0-8e62-54ee0e8f9a86 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.142031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7904-2136-49e0-8e62-54ee0e8f9a86 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.143452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 38/70] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:40.144312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c7904-2136-49e0-8e62-54ee0e8f9a86 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.243853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c509b6-51b1-4830-836f-4400f2fa3bb1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.256338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c7904-2136-49e0-8e62-54ee0e8f9a86 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.275283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.281228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.282042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.282325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.282591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.292981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:40.294363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.295353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.295684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.295901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4afbce08-3314-4f94-81a7-b6584edbcc49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:40.300761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:40.301558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:40.306840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 33/71] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:40.308185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.308550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.308737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.312855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.314400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.316287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 39/72] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.316979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.331803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:40.333441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:40.336453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.402649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 34/73] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:40.403735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.421425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440795f0-10cf-4009-a6e0-1f555a2eba1f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.455731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.456911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.457192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.457462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.467583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:40.475771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:40.476577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:40.477301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 40/74] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:40.478956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.504755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ee7a-cc55-4b8e-92e8-6ca76f4ab483 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.525450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.541105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.541796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.542083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.542364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.543157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.543469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.544997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c57d-5a12-4a27-b5c4-3bdb75014b55 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.554070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 35/75] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.555392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b6ce-e405-496d-8324-fb42253f6b40 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.555686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b6ce-e405-496d-8324-fb42253f6b40 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.555895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.556004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b6ce-e405-496d-8324-fb42253f6b40 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.557379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 36/76] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:40.557941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38b6ce-e405-496d-8324-fb42253f6b40 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.584758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f19e-b868-4ee3-a8a4-958b486ebd8a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.618676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.619368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.619662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.619944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.663283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38b6ce-e405-496d-8324-fb42253f6b40 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.687930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.689567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.696495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.697427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.697719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.697994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.708572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:40.716432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:40.717317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:40.718052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 37/77] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:40.718673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.762632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.769085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.795947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 41/78] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:40.797275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.823830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6af4e2-79d9-41e0-9bff-fe39ff4ffe31 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.856437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.857053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.857338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.857646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.858406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.858722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.860173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2a6b-43ed-4450-93d2-a8ad3ca0906c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.867968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 38/79] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.869138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.869431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.869710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.885514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:40.886712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:40.896740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ca07f-3440-4176-aec0-ccc9b9a08e82 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.930586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.931524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.931789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.932037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.933289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.934775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.936738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 42/80] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.937308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.966810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 39/81] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:40.966810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.988912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.996181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.048537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1dedc-0504-401e-8e7d-262f7aff05da None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.055970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883f49-deb5-43cf-b3db-1597f4f403ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.082543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.083288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.083568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.083870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.084776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:41.085088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.086646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.090281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.091201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.091489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.091845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.093109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.094582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.095500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 43/82] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.096493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.096631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 40/83] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.097082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.199487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819904f4-d47c-4d16-8292-8071f13e4b41 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.200349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed9eb-eb97-4b18-a080-0dfdd09bc552 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.202819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.208923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.233503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.234399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.234682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.234987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.235683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.236177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.236333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.236615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.236887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.237656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.239351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 44/84] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.240114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.303963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.305645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.338084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365fdd-5a0c-4a50-85d5-4dc2007b995c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.371282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.372080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.372368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.372646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.373849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.375357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.377028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 45/85] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.377799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.402147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 41/86] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:41.403083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.405444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.426287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.480306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f288c4-50e4-4af6-9da5-d4c4e69967cb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.502872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393c3c-06bc-4026-be05-61a9c1b68ca0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.512728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.513705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.514007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.514283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.515550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.517013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.518873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 46/87] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.519568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.540601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.541269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.541562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.541837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.542674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:41.543019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.544477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.550071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 42/88] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.550844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.628806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.649851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc56d2-2aaa-470f-a863-6555dec039da None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.666399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.676520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d75b-1dee-4412-b9e7-2b14a7b37171 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.691496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.693103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.693588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.694088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.717898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.718197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.718489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.718770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.720271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.721738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.755330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 43/89] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:41 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:41.756255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.784585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.786459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.885660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f490b1-ebac-41de-a9dc-f2f7d84c33c7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:41.903066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 47/90] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:41.904086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:41.923930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.925000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:41.941656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:41.942658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.942986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.943271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.944524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:41.946133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:41.948379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 44/91] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.949743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.031518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa21-dd2c-4446-ac1f-2c087e947313 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.087894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1fcc-0f2e-45c1-8714-c32efaa3a98c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.090460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.091567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.091567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.091816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.138091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.139158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.139512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.140103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.141609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.144818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.146770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 45/92] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.151843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.222413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.224963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.245469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.250568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.303451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e658b-c2f9-4a2f-b54f-5b4368419450 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.347837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.349036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.349547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.350020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.351259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=72ba3f2f992c417989b7e2463df4d263) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:42.351778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.353686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.361492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 46/93] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/role_assignments?user.id=72ba3f2f992c417989b7e2463df4d263&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.366955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.492952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 48/94] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:42.507920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.619968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e314f-38e4-44c2-bcd5-d8096b3f3494 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.658244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159d9-33ae-49b8-953d-5b9e7cba528b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.659803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.673143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.674874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.675574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.675873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.676192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.677061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:42.677567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.678917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.690651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 47/95] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.710593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.711535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.711813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.712095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] PATH_INFO: `/v3/projects/dc5ae7c580384d90b98199ce1a3efc04` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.719878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] RBAC: Authorizing `identity:get_project(project_id=dc5ae7c580384d90b98199ce1a3efc04)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.721411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1480b-cda3-45d0-9a9f-c95808a2af92 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.723503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 49/96] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/projects/dc5ae7c580384d90b98199ce1a3efc04 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.729883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.875356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f47bb-0916-414f-9b09-bfab363e9aac None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.910767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.911479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.911774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.912057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.912906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=dc5ae7c580384d90b98199ce1a3efc04, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:42.913226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.914698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108f6a-3e95-4e00-a3b3-f3218b7eca2e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.920993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 48/97] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=dc5ae7c580384d90b98199ce1a3efc04&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:44.544973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4a3c-af40-4edf-a78e-50ebac28bcea None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.545946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4a3c-af40-4edf-a78e-50ebac28bcea None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.546367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4a3c-af40-4edf-a78e-50ebac28bcea None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.547934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 50/98] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:44.553760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.554170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.554626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.572075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:44.573304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:44.635126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.663635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 49/99] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:44.698456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a4a3c-af40-4edf-a78e-50ebac28bcea None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.844426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a4a3c-af40-4edf-a78e-50ebac28bcea None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.887341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.888166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.888444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.888818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.907637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d6d9a86f-bff6-423e-99a3-309c6bd68a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:44.915473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:44.916285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:44.917013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:44.917582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 51/100] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:44.922930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.047796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e57fe-7ecb-490d-8be7-64e6609bb928 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.079181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dae1-172d-4998-9fa5-475d40af4681 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.079884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dae1-172d-4998-9fa5-475d40af4681 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.080355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dae1-172d-4998-9fa5-475d40af4681 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.082447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 52/101] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:45.087679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d11-2d74-40ac-8b74-c54008be714d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.087969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d11-2d74-40ac-8b74-c54008be714d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.088253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58d11-2d74-40ac-8b74-c54008be714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.093077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.093769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.094055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.094333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.095134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:45.095451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.096887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.119266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d1c58d11-2d74-40ac-8b74-c54008be714d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:45.120018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 50/102] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.120940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.122244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d1c58d11-2d74-40ac-8b74-c54008be714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:45.188182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.203197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.241722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 53/103] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:45.242976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd77f5-f33d-4aae-8a64-1855082e28f0 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.243272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd77f5-f33d-4aae-8a64-1855082e28f0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.243548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd77f5-f33d-4aae-8a64-1855082e28f0 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.245178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 54/104] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:45.246156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14ea-226b-4686-86cd-7ba4b3fd25dd None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.246443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14ea-226b-4686-86cd-7ba4b3fd25dd None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.246885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14ea-226b-4686-86cd-7ba4b3fd25dd None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.248009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 55/105] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:45.251495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.252375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.252375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.274609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:45.276153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:45.301485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8157-dae5-43ef-b17a-2086f7e6407b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.337623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.338451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.338811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.339153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.340307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.341896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b70-93bd-4514-ae10-2ea419dc4cf5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.343653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 51/106] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.349255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4699-3cec-432c-a2b4-ea8e59a01bff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.349552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4699-3cec-432c-a2b4-ea8e59a01bff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.349892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4699-3cec-432c-a2b4-ea8e59a01bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.350292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 56/107] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:45.351246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.371807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-96fa4699-3cec-432c-a2b4-ea8e59a01bff None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:45.373985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-96fa4699-3cec-432c-a2b4-ea8e59a01bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 52/108] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322e2-f768-4dd1-b7bd-220e07554fc1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322e2-f768-4dd1-b7bd-220e07554fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322e2-f768-4dd1-b7bd-220e07554fc1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 53/109] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:45.449673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322e2-f768-4dd1-b7bd-220e07554fc1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.461351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.464627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb221ed-a5f6-4d1e-a7fb-c065f8a45d08 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.501700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.503379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.504309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.504600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.504887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.506073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.507575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.509327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 57/110] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.510097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.570402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322e2-f768-4dd1-b7bd-220e07554fc1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.607013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.608239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.608784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.609345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.610605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.612343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42432-4cb5-4a83-871c-8d6ef3be0980 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.618824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 54/111] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.618968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c698b-8597-4139-bd47-e3cd4e082a36 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.619374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.619374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.619374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:45.636789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:45.652635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.653454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.653740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.654017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.666591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:45.674655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:45.675551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 58/112] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:45.681523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.714719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.730801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:45.730801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.771508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.810464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d2a-6eab-45b8-9c6e-caa1d6904077 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.845138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.845984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.846274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.846554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.847922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc03f6-94ba-4e93-9cdc-b54c6cf1beca None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.857988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:45.866172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:45.867038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 59/114] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:45.871274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.891530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.892939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.893378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.893714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.894445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.895950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.922141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 56/115] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:45 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:45.923367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.972609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.987532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea265-80b3-4f59-a04a-f7f2284ec46c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.029796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.030729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.031063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.031339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/d433e7449d234a78ae97850207c8abb0/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.033446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, user_id=d433e7449d234a78ae97850207c8abb0, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.035045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.052241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 60/116] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:45 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/d433e7449d234a78ae97850207c8abb0/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:46.053570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.064321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.079611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad964f-5c1c-4ac0-a722-60497964c1c4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.129469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.130163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.130490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.130773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.131580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.131917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.133366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.142898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 57/117] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.143763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.201534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca8ed-b2c5-45e4-99dc-02360c310d2f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.242405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.243645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.243929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.244207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.257427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e3699f82-cda3-4436-8043-fb32cb145362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:46.267978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:46.268829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:46.269591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 61/118] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:46.271784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f207-2926-4df9-86c6-18961c81bcf6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.276446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b509-3799-4ac0-a123-97b4d4830eff None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.278920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b509-3799-4ac0-a123-97b4d4830eff None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.279487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b509-3799-4ac0-a123-97b4d4830eff None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.281845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 62/119] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:46.282913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646b509-3799-4ac0-a123-97b4d4830eff None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.297695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.315433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.316183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.316475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.316787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.317686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.317998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.319552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.328429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 58/120] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.333467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.350208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.418038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646b509-3799-4ac0-a123-97b4d4830eff None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.449350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9356ae-57be-469a-a97e-38d8807b3b1d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.463029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.464608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.465209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.465608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] PATH_INFO: `/v3/users/629df731cfeb4bb2a347861ecd5f28e9` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.484063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] RBAC: Authorizing `identity:get_user(user_id=629df731cfeb4bb2a347861ecd5f28e9)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.486363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd07e5-9aca-48b9-9bfd-896b5d341c2d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.494702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 63/121] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/users/629df731cfeb4bb2a347861ecd5f28e9 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.494702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.494702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.494702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.500580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.501462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.501884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.502297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.503266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.503715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.505454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.512629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:46.514405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:46.515679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 59/122] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.516643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.592444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.596563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 64/123] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:46.606408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.616639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.647167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d96da-9e2b-4872-be15-e1db5521d0c3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.691437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.692636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.693484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.693911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.695700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.698472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.701134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 60/124] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.702195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.719376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bb5a-0a69-40c0-ad61-457020c08161 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.755642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.756424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.756769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.757113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.822288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.832475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.835214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.855097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87ec1-5495-4e9a-9c21-4b8ce7268978 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.895831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.896822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.897174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.897569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.898859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.900389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.906705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 61/125] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.906705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.919745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.980404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:46.981924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.007399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2211db-4ae2-4122-aea6-988b8f852574 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.042041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.043096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.043375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.043797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.054427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:47.062422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:47.063372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:47.064126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:47.068795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 62/127] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:47.069650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.088415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.095635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde7fe-4a99-495a-9d66-2d282de2c4f5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.135385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.136649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.137137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.137627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.139358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.141115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.143438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 66/128] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.144925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.145070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.181274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be3785-c7e7-460a-91c6-3e68a203410a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.220607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.221756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.222295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.222718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.224109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.225854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.228421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 63/129] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.229375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.262399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23044bf-8b2b-4729-b298-a79387931868 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.298833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.300489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.300878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.301262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.302674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.304691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.306739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 67/130] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.307361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.348384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b133-4d48-4182-b7bc-c7342f1b41a1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.350047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.385363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.386440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.386952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.387450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.388400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.388957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.390645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.399812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 64/131] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.400943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.403865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.441321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf35f8-34f6-43e1-b26d-6aa9fda611e7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.492594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.493521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.493810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.494092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/d433e7449d234a78ae97850207c8abb0/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.496993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, user_id=d433e7449d234a78ae97850207c8abb0, role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.499284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.515625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a33c-01dd-4916-9540-859e26b0639a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.516186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 68/132] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:47 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/d433e7449d234a78ae97850207c8abb0/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:47.516835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.555430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.556795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.557279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.557775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/72ba3f2f992c417989b7e2463df4d263/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.560120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, user_id=72ba3f2f992c417989b7e2463df4d263, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.561901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.581654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 65/133] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:47 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/72ba3f2f992c417989b7e2463df4d263/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:47.582936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.652664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.660751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.671505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63625-6048-4cbc-a72e-1184f04c0515 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.716025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b9eb-0009-4437-851f-4c32e4add843 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.723595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.724285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.724578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.724857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.725719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=629df731cfeb4bb2a347861ecd5f28e9) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.726036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.727734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.737227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 69/134] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/role_assignments?user.id=629df731cfeb4bb2a347861ecd5f28e9&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.760412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.761630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.762056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.762498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.764206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.766040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.768140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 66/135] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.775039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.910438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40643-71b7-4bbd-adb3-43f18935ea8e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.949590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.950532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.950844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.951193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] PATH_INFO: `/v3/projects/dc5ae7c580384d90b98199ce1a3efc04` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.952487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] RBAC: Authorizing `identity:get_project(project_id=dc5ae7c580384d90b98199ce1a3efc04)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.953992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638173d-3a1c-4502-a38d-6f75255276cc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.955854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 70/136] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/projects/dc5ae7c580384d90b98199ce1a3efc04 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.962281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.079961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275b32-a804-4ab0-aee4-305f5b58b905 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.119775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.128543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.129740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.130228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.130705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] PATH_INFO: `/v3/projects/dc5ae7c580384d90b98199ce1a3efc04/users/d433e7449d234a78ae97850207c8abb0/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.133640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc5ae7c580384d90b98199ce1a3efc04, user_id=d433e7449d234a78ae97850207c8abb0, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.135324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5c04-23de-4a78-8331-b335d009e716 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.168155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 67/137] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:47 2022] PUT /identity/v3/projects/dc5ae7c580384d90b98199ce1a3efc04/users/d433e7449d234a78ae97850207c8abb0/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:48.176964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f623d4-0a61-4641-87f9-b0bb98150b9c None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.177580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f623d4-0a61-4641-87f9-b0bb98150b9c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.178004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f623d4-0a61-4641-87f9-b0bb98150b9c None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.179714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 71/138] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:48.185948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acaec-e324-4582-a22d-1b3781064bc5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.186565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acaec-e324-4582-a22d-1b3781064bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.187260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acaec-e324-4582-a22d-1b3781064bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.209636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eb0acaec-e324-4582-a22d-1b3781064bc5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:48.211312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb0acaec-e324-4582-a22d-1b3781064bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:48.301657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:48.341032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f623d4-0a61-4641-87f9-b0bb98150b9c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.375457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.477785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f623d4-0a61-4641-87f9-b0bb98150b9c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.481326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd751e-8ed0-4e4f-8b00-0549fc7abfe7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.481801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd751e-8ed0-4e4f-8b00-0549fc7abfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.482259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd751e-8ed0-4e4f-8b00-0549fc7abfe7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.487564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 69/140] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:48.494304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.494834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.495265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.515598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.516590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.517009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.517292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.518512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.520109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.520807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:48.521847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 72/141] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:48.522448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:48.527359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.626148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 70/142] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:48.627852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.635465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde23e7e-8c74-4a00-a3d7-9c0364245fcd None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.662152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.671270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.671978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.672258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.672542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.673266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.674873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.715409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 73/143] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:48 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:16:48.751598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.822456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420387b-22bb-4697-a04c-03ab8c0d26df None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.869198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.870046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.870338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.870614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.886710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:48.894903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:48.895755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:48.896524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 71/144] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:48.902366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.032704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e1e14-744d-4190-b0b4-b0d01bcd66e2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.073886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.074988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.075489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.075993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.077069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:49.077589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.079253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.088983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:49.094987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.242549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9d55-ea64-46fa-a1ee-dda27a89d369 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.253198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.282847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.283747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.284033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.284311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.289108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.290619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.292646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:49.298342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.317287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.426627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185fabb-bdc9-4f2d-983f-d97167939e35 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.465829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.467307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.467932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.468415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.543812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.545643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.558838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.659660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:49.665750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.825700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3b2c-d58c-4997-877d-a0343b3b3ecc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.873598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.874486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.874766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.875062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.876291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.877772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da5d27-16bd-4168-9e72-73061bddf33a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.879555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 73/148] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:49.885583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.026012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d5582-7a43-4969-ade6-767f0f5b8fdb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.042453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.073942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.074553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.074859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.075141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.076021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.076337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.077815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c389-0978-429a-8e02-cca2a21646ae None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.084585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 76/149] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:50.410944 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e341b-f73d-4f97-b2c5-2d54bd7022fc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.411355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e341b-f73d-4f97-b2c5-2d54bd7022fc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.411522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e341b-f73d-4f97-b2c5-2d54bd7022fc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.413189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 74/150] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:50.418614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.418932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.419211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.445771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:50.447042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:50.525576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 77/151] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:50.565384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e341b-f73d-4f97-b2c5-2d54bd7022fc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.626756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.692124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e341b-f73d-4f97-b2c5-2d54bd7022fc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.734859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.735809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.736093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.736363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.750091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:50.758099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.758966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:50.759696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 75/152] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.765805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.889355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295a13-0826-4fd3-ac2f-2138c312756a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.895625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.935625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.936318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.936604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.936884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.937647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.937948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.939426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f81f-e3bd-41e9-a91c-38cc131a08e2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.948387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 78/153] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:50.954921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.965447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5e57-7977-4aab-8a77-e82ab6c562f0 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.965747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5e57-7977-4aab-8a77-e82ab6c562f0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.966004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5e57-7977-4aab-8a77-e82ab6c562f0 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.967585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 79/154] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:50.977064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.977343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.977617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.009462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:51.011060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:51.119748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878d-c146-49b3-b869-cefa9942db03 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.129591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.131539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 80/155] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:51.167991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.168898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.169179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.169452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] PATH_INFO: `/v3/users/629df731cfeb4bb2a347861ecd5f28e9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.171966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] RBAC: Authorizing `identity:get_user(user_id=629df731cfeb4bb2a347861ecd5f28e9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.173451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.175128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 76/156] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/users/629df731cfeb4bb2a347861ecd5f28e9 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.180735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.180997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.324268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.330635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765e7b5-62cc-4ebd-84b3-5d70656e23bf None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.340229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7254acc-c4d6-4cdf-b2c2-fbec2684564e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.393532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.394910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.395389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.395912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.400193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.401893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.404177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 81/157] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.410002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.410978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.411832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.412113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.412386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.431981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:51.440870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:51.441809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:51.442549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:51.447176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 77/158] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:51.448090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.523134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.614766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faad3f-b638-4845-b167-86a47da83854 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.664993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5455d05-4b38-4191-8750-80d266604d81 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.679737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.680990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.681481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.681963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/629df731cfeb4bb2a347861ecd5f28e9/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.684266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, user_id=629df731cfeb4bb2a347861ecd5f28e9, role_id=3d16ac40dc2d4f6cbe1bfe8a81335dff)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.687063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8351fd-ae6b-4bf0-af41-bc53a7c8c846 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.708944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 82/159] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:51 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/users/629df731cfeb4bb2a347861ecd5f28e9/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:16:51.710641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637f4c-7aa2-4c94-b136-8a021df1c317 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.711175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637f4c-7aa2-4c94-b136-8a021df1c317 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.711669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637f4c-7aa2-4c94-b136-8a021df1c317 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.713204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 83/160] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:51.714643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a500-33f5-4d6d-9304-c963c6124b4f None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.715156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a500-33f5-4d6d-9304-c963c6124b4f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.715624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a500-33f5-4d6d-9304-c963c6124b4f None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.718262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 84/161] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:51.725072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.725769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.726545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.740013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.740013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.740013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.740013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.740831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.740831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.741951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c0ac-d5ee-4d2b-bf15-8e4b90f68b24 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.764108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 78/162] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.765485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.765773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.766952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.768115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:51.769522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:51.806438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:51.809448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:51.820732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.896269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 79/163] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:51.897434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.938212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 85/164] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:51.939022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.943134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.055891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db385-d6dd-4d2f-95d6-05f5154c00b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.097496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.099204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.099829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.100302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.102763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.104687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.107050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 80/165] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.108192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.218424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639660-28ad-4832-b554-cd5b0991c32d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.220834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.249746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24970ed-57e3-492d-814b-4c40f7ea5213 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.258181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.259317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.259806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.260290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.272839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:52.281673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:52.282492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:52.283270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:52.286273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 81/166] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:52.287336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.308095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.308932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.309216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.309487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.336743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:52.353178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:52.354118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:52.354897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 86/167] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:52.355534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.394809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.480928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5800e-4177-42a7-9bf5-d8a0cc7cdc8a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.535220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eef9b-e3ff-421d-812d-3e98dfd19588 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.556902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.557586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.557858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.558133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.589451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.590530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.591069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.591592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.592552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.593065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.594665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.613314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 87/168] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.614502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.623878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.747995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.749405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.761585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.819513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855f26-0d5f-40be-8fd2-f58550963265 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.860165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.861340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.861816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.862300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.863315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.863818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.865514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.874674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 88/169] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.875818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.972995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 82/170] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:52.976136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.069060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7b12-0fd4-48a9-9962-f2b47cfbb2a1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.090630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.135966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.137244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.138658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.139827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] PATH_INFO: `/v3/users/d433e7449d234a78ae97850207c8abb0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.142364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d433e7449d234a78ae97850207c8abb0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.145126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.150064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 89/171] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/users/d433e7449d234a78ae97850207c8abb0 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.151303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.165037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.174192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bfeab-faf4-4be1-ad7e-fe8c0467e490 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.242562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.243721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.244246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.244657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] PATH_INFO: `/v3/users/72ba3f2f992c417989b7e2463df4d263` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.246027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] RBAC: Authorizing `identity:get_user(user_id=72ba3f2f992c417989b7e2463df4d263)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.247745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8701e4-c912-465e-8574-1aeed3a8e28f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.252398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 83/172] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/users/72ba3f2f992c417989b7e2463df4d263 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.254409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68baf2-1a60-40c4-8f4d-6703ba410d80 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.255062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68baf2-1a60-40c4-8f4d-6703ba410d80 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.256172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68baf2-1a60-40c4-8f4d-6703ba410d80 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.257758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 84/173] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:53.259682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68baf2-1a60-40c4-8f4d-6703ba410d80 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.307699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffabb3-ff02-482f-89ec-f2b02aa97cb3 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.353400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.355215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.355644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.356057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.358171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.359820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.363062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 90/174] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.363990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.386544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68baf2-1a60-40c4-8f4d-6703ba410d80 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.414409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.429894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.430566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.430877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.431160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.472244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.497880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0a25-e2f2-4dce-9a7e-24e0d2881248 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.508020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.509602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaf709-0838-4887-9c73-65249a49099f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.533021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.533692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.533974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.534247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.611653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.613557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7046b16-a2ea-4c4c-aa89-1e64334fc8ba None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.625975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 85/175] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:53.631113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2931-6553-4572-a195-1293d7a7219b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.631113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2931-6553-4572-a195-1293d7a7219b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.631113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2931-6553-4572-a195-1293d7a7219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.643621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-25da2931-6553-4572-a195-1293d7a7219b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:53.644820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-25da2931-6553-4572-a195-1293d7a7219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:53.662123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.696290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.714673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 86/176] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:53.716741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa50f1-4b98-495b-87d2-9bfe58213448 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.717028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa50f1-4b98-495b-87d2-9bfe58213448 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.717305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa50f1-4b98-495b-87d2-9bfe58213448 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.718976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 87/177] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:53.723584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa50f1-4b98-495b-87d2-9bfe58213448 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.735280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 91/178] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:53.737617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b9d9-f48d-47f3-9fc9-40a8b9088218 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.737957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b9d9-f48d-47f3-9fc9-40a8b9088218 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.738235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b9d9-f48d-47f3-9fc9-40a8b9088218 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.740135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 92/179] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:53.741128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b9d9-f48d-47f3-9fc9-40a8b9088218 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.842515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa50f1-4b98-495b-87d2-9bfe58213448 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.857223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b9d9-f48d-47f3-9fc9-40a8b9088218 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.878934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.879529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.879805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.880382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.880913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:53.881225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.882684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be3c4-4964-498f-bfdf-d13631892b59 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.888888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 88/180] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.892602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.893206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.893879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.894855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.895751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.896037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.896302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] PATH_INFO: `/v3/projects/dc5ae7c580384d90b98199ce1a3efc04` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.897665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] RBAC: Authorizing `identity:get_project(project_id=dc5ae7c580384d90b98199ce1a3efc04)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.899141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.901144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 93/181] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/projects/dc5ae7c580384d90b98199ce1a3efc04 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.901792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.916666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:53.918263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:53.931442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.951517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.998252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 89/182] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:53.999543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.014893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245946ce-f425-4634-9541-4943c8d7fb38 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.052919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.053751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.054037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.054370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.066677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-f5d76285-487f-4138-8235-8119c51f590c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:54.074887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:54.075951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:54.076710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 94/183] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:54.077829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.077928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.078141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.098911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:54.100203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:54.116454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec54e-3691-43ce-9826-246d2b7404af None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.159551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.160486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.160756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.161072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.162648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.164544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.168040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 90/184] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.169030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.183803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 95/185] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:54.184672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.187047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.224932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.286092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be44e3-c6e4-4cfd-8452-d73eec72bbd2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.295389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d89b0-c689-4102-8aa0-f218e0522d5a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.320079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.320863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.321431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.321431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.322356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=dc5ae7c580384d90b98199ce1a3efc04, user.id=d433e7449d234a78ae97850207c8abb0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.322587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.324091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.330106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 91/186] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/role_assignments?user.id=d433e7449d234a78ae97850207c8abb0&scope.project.id=dc5ae7c580384d90b98199ce1a3efc04&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.331282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.341494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.343043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.343356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.343599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.356005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:54.365148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:54.366091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:54.366982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 96/187] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:54.367625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.432558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.463991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef358a-1d7f-4362-8ad4-8c6255e2ee30 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.477293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.487366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ede6-5a88-4d6f-a8e9-178b88640256 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.509241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.509943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.510236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.510511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.511325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.511637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.513994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.522617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 92/188] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.523473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.524892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.525558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.525843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.526116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.527660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=72ba3f2f992c417989b7e2463df4d263) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.527982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.529533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.536494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 97/189] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/role_assignments?user.id=72ba3f2f992c417989b7e2463df4d263&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.543850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.659354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae9ee-c761-46b3-a614-da6b2effd7fa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.673550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded02b9-c7c1-461d-b6e3-04aa7dcd3c58 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.697615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.698358 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.698639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.698955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.700140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.701732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbdf7a-c884-484c-bf77-e8b6236405fd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.703568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 93/190] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.704600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062d3c-a4a3-4e21-b65e-597a0416f0a6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.704873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062d3c-a4a3-4e21-b65e-597a0416f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.705147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062d3c-a4a3-4e21-b65e-597a0416f0a6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.706732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 94/191] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:54.707452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0062d3c-a4a3-4e21-b65e-597a0416f0a6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.713434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.714132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.714410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.714690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.715548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.715852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.717281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15788649-b423-42a6-aa9f-6f162de0397a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.719758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.728130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 98/192] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.729392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.729498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.729781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.748000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:54.749207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:54.768279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.823710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 99/193] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:54.824719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.827338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0062d3c-a4a3-4e21-b65e-597a0416f0a6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.862269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.863180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.863457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.863726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.876717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.878169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.879855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 95/194] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.880607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.925263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e56cf8-1045-4a1b-a657-e8662a08b30f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.944616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.959231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.959849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.960154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.960417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.961133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.962591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.980296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a390-c8ba-4c55-a389-de70cfb3e9c0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.980909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 100/195] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:54 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:54.981710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.985181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.022117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.023059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.023344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.023616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.024883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.026368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.028102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 96/196] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.033796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.099371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d33b8-22d9-48c3-873e-5b829121f55e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.135670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.136515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.136782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.137099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.149740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:55.150378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49a9f-6798-49c2-872d-1662cc205918 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:55.158439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:55.159344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 101/197] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:55.160106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.195569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.196055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.196343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.196622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.201229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.239185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.283893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.285428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.287667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd762b6-f0a6-489e-999a-5f6cedd3f617 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.327078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.327754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.328037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.328319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.402217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 97/198] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:55.403121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.415916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.417538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.438766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.489564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.517313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e66f7-2772-4488-8678-9e680c6c21b4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.537278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 102/199] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:55.538282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.566612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.567581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.567868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.568153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.569586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:55.569903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.572082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.583720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 98/200] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.584645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.649774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4a59-cb34-4e2d-9a8f-c2fbbad19753 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.687607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.688933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.689389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.689834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.691321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.693128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.695224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 103/201] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.696154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.715249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.721676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc11a-7e16-4584-a63a-d46643b12f2b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.731427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.761180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.762141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.762505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.762867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.764869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.768931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.771844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 99/202] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.778163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.809634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb62d1-400b-433e-8bf8-8741b4480c6e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.847625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.848968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.849464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.849933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] PATH_INFO: `/v3/users/629df731cfeb4bb2a347861ecd5f28e9` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.851640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] RBAC: Authorizing `identity:get_user(user_id=629df731cfeb4bb2a347861ecd5f28e9)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.853371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.855531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 104/203] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/users/629df731cfeb4bb2a347861ecd5f28e9 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.856546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.894756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501dfc-42a9-428e-8794-e3b99281e840 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.933368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.933607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.933811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.934051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.934935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=ea82666acd254d4aab947bdba48e2885) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:55.935391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.936875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.943056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 100/204] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/role_assignments?user.id=ea82666acd254d4aab947bdba48e2885&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.943686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.966800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a27c-e61f-48e3-8fe3-e428b7450f64 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.969000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.004182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.009439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.010494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.011013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.011564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.012730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=ea82666acd254d4aab947bdba48e2885) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:56.013323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.015107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.022506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 105/205] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/role_assignments?user.id=ea82666acd254d4aab947bdba48e2885&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:56.100645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cc93a-113e-4782-abc7-2b96ef003876 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.139836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.140525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.140807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.141080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.217203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.218718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.248929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.340691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 101/206] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:56.347914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.476743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5074-b5e2-49bd-a287-1fc1bd129454 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.516121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.517399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.517901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.518373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.519844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.521536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1ad86-93e2-4de1-a8d1-b015977a9ca7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.523487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 106/207] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:56.530813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.683943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59194f3-15fa-4d95-9e17-b87a32119d04 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.721669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.729842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.735550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.735839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.736122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.736976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8, user.id=629df731cfeb4bb2a347861ecd5f28e9) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:56.737293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.738752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359981c8-4114-4bf3-b9d2-f13f11ec56e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.745207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 102/208] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/role_assignments?user.id=629df731cfeb4bb2a347861ecd5f28e9&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.245948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503d7a-2bd7-421c-8993-d0e944dfbd34 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.246682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503d7a-2bd7-421c-8993-d0e944dfbd34 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.247227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503d7a-2bd7-421c-8993-d0e944dfbd34 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.249007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 107/209] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:57.255689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e28b-2fd6-4e8b-b66c-9776f88a8de6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.256230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e28b-2fd6-4e8b-b66c-9776f88a8de6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.256230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e28b-2fd6-4e8b-b66c-9776f88a8de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.276611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-62e2e28b-2fd6-4e8b-b66c-9776f88a8de6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:57.277807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-62e2e28b-2fd6-4e8b-b66c-9776f88a8de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:57.357764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 103/210] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:57.382597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503d7a-2bd7-421c-8993-d0e944dfbd34 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.424330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.497380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9ca3-88b4-4a94-9cf7-9a49796c47e6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.497822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9ca3-88b4-4a94-9cf7-9a49796c47e6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.498201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9ca3-88b4-4a94-9cf7-9a49796c47e6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.500511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 104/211] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:57.506206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503d7a-2bd7-421c-8993-d0e944dfbd34 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.507282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.507797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.508267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.526241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:57.527889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:57.542477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029568-1408-454e-888c-e783835ab08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.543333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029568-1408-454e-888c-e783835ab08d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.543617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029568-1408-454e-888c-e783835ab08d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.543893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029568-1408-454e-888c-e783835ab08d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.545114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029568-1408-454e-888c-e783835ab08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.546593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029568-1408-454e-888c-e783835ab08d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.548304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 108/212] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.553729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029568-1408-454e-888c-e783835ab08d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.612834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 105/213] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:57.636455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.659063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.663248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029568-1408-454e-888c-e783835ab08d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.700836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.702071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.702607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.703052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.703839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.704689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.707077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.731994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 109/214] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:57 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:16:57.765201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe9654-04ff-4fa0-ba97-79f2841ed528 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.820039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.820878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.821165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.821437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.834438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:57.842525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:57.843478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:57.844877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 106/215] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:57.852010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.963791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77078d-d24f-4f6c-bdd4-f1c27f29fd6c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.999082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.999777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.000053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.000327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.001146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:58.001457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.002921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a766d-2b16-47c0-bdd2-7f4503ff38c1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.011989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 110/216] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:58.017799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.129812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ac1b6-aa22-48fe-b70e-596fc0873269 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.143780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.167174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.168080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.168360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.168634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] PATH_INFO: `/v3/users/6e8350434bd34ed78ebf2282c32e9912` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.179997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bf9a-923c-40df-a860-3354b698cc27 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.180581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bf9a-923c-40df-a860-3354b698cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.181039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bf9a-923c-40df-a860-3354b698cc27 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.186524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] RBAC: Authorizing `identity:get_user(user_id=6e8350434bd34ed78ebf2282c32e9912)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.186524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452fc33-3172-476a-998c-9ef8fe182126 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.187085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 107/217] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/users/6e8350434bd34ed78ebf2282c32e9912 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:58.187436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 111/218] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:58.188322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.188604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.188881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.193065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0bf9a-923c-40df-a860-3354b698cc27 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.206900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:58.208111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:58.216560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.293849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 108/219] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:58.320054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0bf9a-923c-40df-a860-3354b698cc27 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.323537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.392002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.392673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.392957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.393229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.500699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.503507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.504521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72142-1fc2-4a9e-8f66-00a6058bb3ad None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.505050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5eb42-7ba0-445d-b2f2-13d40eeb1ef4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.528262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.542325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.543268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.543633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.543966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.554984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7d9214ba-e201-4cdc-81bf-dca318bfbad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:58.563518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:58.564386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:58.565602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 109/220] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:58.566418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244273-f0a7-426f-9c37-8efcb45a0691 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.567674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244273-f0a7-426f-9c37-8efcb45a0691 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.567674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244273-f0a7-426f-9c37-8efcb45a0691 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.570806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 110/221] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:58.577421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244273-f0a7-426f-9c37-8efcb45a0691 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.626694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 112/222] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:16:58.628172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.628552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.628736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.650815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:58.650815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:58.700916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244273-f0a7-426f-9c37-8efcb45a0691 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.722862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 113/223] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:58.724069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.745914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.746608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.746963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.747539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.748409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:58.748806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.750541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.763213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 111/224] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:58.764238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.786913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.805090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.845260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643808aa-3ae1-4d45-aef7-432ee62eef4c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.880868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.881928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.882302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.882675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.884015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.885625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.888454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 114/225] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:58.889308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.914038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2053a7-5f54-4326-8e76-2ba120df45f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.961656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.962487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.962766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.963097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.975444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:58.984507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:58.985403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:58.986167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:16:58.991136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 112/226] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:58.992568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.024304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b26ca-45f7-45a8-a946-e35669285910 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.047026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.070718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.072170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.073210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.073693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.075630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.078150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.080392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 115/227] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.081790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.096943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.123744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b33f99-380e-4c0e-b271-cb3268fde306 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.165113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.165928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.166347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.166627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.167497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=6e8350434bd34ed78ebf2282c32e9912) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.167811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.169274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.182809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 113/228] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/role_assignments?user.id=6e8350434bd34ed78ebf2282c32e9912&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.182809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.244382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7849-8bac-4041-b074-5e3192e00366 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.322362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.324733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.326211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.330038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.331611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.332129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.333821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.353156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 116/229] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.358497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.384032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b6e-1d49-42b8-a611-357d1f9d26b8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.417642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.446125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.447599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.450252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.450828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.452483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.455176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.460382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 114/230] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.467580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.495168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.522855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72133ce-baf0-4f96-b051-b07ca353e52c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.563790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.564867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.565393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.565779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.567688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.569445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.572018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 117/231] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.582893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.654663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018443d9-0fb2-40b0-9745-4a8d839611ad None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.720603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ebf5-560d-454a-ad30-d8caeb1d9a9d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.727491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.728421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.728705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.728982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/ea82666acd254d4aab947bdba48e2885/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.731088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, user_id=ea82666acd254d4aab947bdba48e2885, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.732629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.742741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.753865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 115/232] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:59 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/ea82666acd254d4aab947bdba48e2885/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:59.779904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.780826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.781102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.781377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.787375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.788897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766945ad-d5e0-4782-82b8-791b11ba89ea None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.791076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 118/233] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:59.798573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.890636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.922003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6cf2-72c6-4e3c-a9f8-46982d847f89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.959470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.960399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.960678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.960952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/ea82666acd254d4aab947bdba48e2885/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.963320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, user_id=ea82666acd254d4aab947bdba48e2885, role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.964819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348686-4627-4153-99ff-16b4d4beb451 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.982269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 116/234] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:59 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/ea82666acd254d4aab947bdba48e2885/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:00.147616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bceeb8-7ef0-4e70-84fc-01f89a0bb304 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.147801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bceeb8-7ef0-4e70-84fc-01f89a0bb304 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.148081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bceeb8-7ef0-4e70-84fc-01f89a0bb304 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.149634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 119/235] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:00.156564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6facad-edef-4745-8205-69f8dca5bd81 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.156857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6facad-edef-4745-8205-69f8dca5bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.157135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6facad-edef-4745-8205-69f8dca5bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.176117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6a6facad-edef-4745-8205-69f8dca5bd81 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:00.177887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a6facad-edef-4745-8205-69f8dca5bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:00.251387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 117/236] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:00.275621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bceeb8-7ef0-4e70-84fc-01f89a0bb304 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.388332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58d7-8603-4702-8a34-d48f5eaa2885 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.388877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58d7-8603-4702-8a34-d48f5eaa2885 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.388877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58d7-8603-4702-8a34-d48f5eaa2885 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.390425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 118/237] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:00.395558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.395842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.396118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.417374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:00.418504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:00.450296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bceeb8-7ef0-4e70-84fc-01f89a0bb304 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.523778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.538346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 119/238] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:00.538823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.539657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.540077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.540324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.552267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:00.561348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:00.562211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:00.563037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:00.564592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 120/239] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:00.569338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.586742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.663207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.725471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82baee-b38e-43cb-8904-b457482a0f92 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.763485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.764307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.764588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.764870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.766062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.767982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.769629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 121/240] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:00.775418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.785675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f750ba-a711-4dca-94d7-1412736b6a92 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.861312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.861997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.862277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.862549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.863333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:00.864157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.865585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.883896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 120/241] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:00.891049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.940467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f454c10-e804-4c02-9dac-3bcf10794889 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.951834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.974817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.975574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.975809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.976091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.976894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.978284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.005491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 122/242] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:00 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:01.025331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.076449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f7826-b95b-4f83-8131-0f90e6b4eaf4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.117615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.118543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.118843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.119118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] PATH_INFO: `/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.143693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] RBAC: Authorizing `identity:get_user(user_id=80ea62ed25e74f8fb69b3e2a8d76af8f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.145264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.147334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 121/243] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:01.154523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.303021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4f02-e3ab-4742-9a7a-30a2c74eeb3a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.338961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.339626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.339903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.340171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.375198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.414334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.415834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4d1b-b921-4e90-b565-25fcb9391f4f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.526484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 123/244] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:01.532600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.683845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8d0e-51b5-4420-9596-10002444e6ed None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.699300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.716040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762079-f3af-4a5e-8cc5-686bb4d26a25 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.716591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762079-f3af-4a5e-8cc5-686bb4d26a25 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.716665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762079-f3af-4a5e-8cc5-686bb4d26a25 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.718056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 124/245] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:01.723649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.724790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.725716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.729875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.731049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.731526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.732075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.733467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.735206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.737443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 122/246] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:01.742948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.754686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:01.756211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:01.879164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.895691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 125/247] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:01.910540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b3ca-e6be-4716-b3c2-3088ee60ff49 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.956550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.957255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.957612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.957955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.958916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=80ea62ed25e74f8fb69b3e2a8d76af8f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:01.959321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.960998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.965881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.967915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 123/248] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/role_assignments?user.id=80ea62ed25e74f8fb69b3e2a8d76af8f&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:02.129104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff85cc9-19f9-4fd7-8c0d-f6561e8e05ac None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.175037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.175860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.176136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.176402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.198344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ae32a328-2bc2-408d-b599-c11948618012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:02.206536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:02.207458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:02.208649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 126/249] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:02.214065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.225272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681d0d2-b989-47cd-a8bf-ad38cd8076d7 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.225588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681d0d2-b989-47cd-a8bf-ad38cd8076d7 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.225829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681d0d2-b989-47cd-a8bf-ad38cd8076d7 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.227439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 127/250] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:02.242630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.242974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.243215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.293663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:02.295098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:02.300915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.364308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d85be-d170-4c5b-b4f0-4c666381cb05 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.399195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.403281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.404920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.405335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.405848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.406842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.407397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.408814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.418397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 124/251] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:02.424916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.430457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 128/252] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:02.520031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.559971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729f89-6350-421f-8214-8ea4d61af158 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.575772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.608212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.609417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.609900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.610349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] PATH_INFO: `/v3/users/6e8350434bd34ed78ebf2282c32e9912` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.611780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] RBAC: Authorizing `identity:get_user(user_id=6e8350434bd34ed78ebf2282c32e9912)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.613851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.616058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 125/253] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/users/6e8350434bd34ed78ebf2282c32e9912 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:02.621751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.699210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485653-24df-4829-a4da-76e4d9aba248 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.734109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.735646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.736160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.736642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.745733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9b3a-8a0c-410c-8a7c-3e2a1d34d552 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.747520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0a275711-b5cf-46a6-8b62-55f08af52042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:02.755621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:02.756474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:02.757228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:02.759865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 129/254] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:02.761272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f6b0-6d23-4509-975c-b50dd95ac4df None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.761780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f6b0-6d23-4509-975c-b50dd95ac4df None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.762286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f6b0-6d23-4509-975c-b50dd95ac4df None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.764105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 130/255] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:02.767701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f6b0-6d23-4509-975c-b50dd95ac4df None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.789028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.789839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.790125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.790398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.792851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.794564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02400ea0-e854-41c1-9418-170d27977e26 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.799694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 126/256] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:02.801071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.801357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.801631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.834985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:02.837266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:02.843426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.915983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.938335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f6b0-6d23-4509-975c-b50dd95ac4df None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.979520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.980549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.980971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.981566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 127/257] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:02.981966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.982460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.983254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.983716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.985299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.995671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 131/258] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:03.002045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.121239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b782-a5ad-4302-a1a6-9407804864a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.140332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb1867-4481-4700-b815-58bbe5ddcf8b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.151006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.172010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.173038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.173414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.173800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/6e8350434bd34ed78ebf2282c32e9912/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.176121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, user_id=6e8350434bd34ed78ebf2282c32e9912, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.177458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.181138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.182390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.183074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.183491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.185213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.187120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.188993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 132/259] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:03.194342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.217034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 128/260] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:02 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/6e8350434bd34ed78ebf2282c32e9912/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:03.217034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.289713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.362679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e289dd0-c093-4dba-88bc-4d4111be4364 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.420025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.421816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.422403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.422935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.447536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:03.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:03.457545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:03.458624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 133/261] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:03.465398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.535048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b0fb-6707-41fa-8e0a-582dae34a009 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.559287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.597890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.598596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.598909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.599192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.640841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3a64-d082-443a-8fe2-3dffd3ddb4fb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.679899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.680861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.681335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.681760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.682701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:03.683227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.684965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.690622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.692157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.699345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 134/262] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:03.701227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.730485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.847487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 129/263] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:03.852922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.900508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.906456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728fdc5-3513-43e1-9c84-1d7454fcc2f1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.999608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.000439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.000715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.000985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] PATH_INFO: `/v3/users/ea82666acd254d4aab947bdba48e2885` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.002241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] RBAC: Authorizing `identity:get_user(user_id=ea82666acd254d4aab947bdba48e2885)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.003723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.005560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 135/264] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/users/ea82666acd254d4aab947bdba48e2885 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:04.010981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.042523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752149-13a6-44f9-b153-24b6d64e9cc8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.140476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.141767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.142253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.142718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.147533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.149250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.151264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 130/265] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:04.157984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.167109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:04.271099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c626-661e-43f6-b64b-334ffacd072c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.333918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.334580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.334892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.335175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.355825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b79b-754d-4c5b-812f-64b6f0e68849 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.389443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.390112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.390393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.390663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.391541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=ea82666acd254d4aab947bdba48e2885) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:04.391849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.393311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8cf2-a547-4ded-ac2e-ca0a6609ae9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.399536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 131/266] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/role_assignments?user.id=ea82666acd254d4aab947bdba48e2885&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:04.400808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a6e64-3ed7-4f0c-bb39-3b5358bab16c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.401137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a6e64-3ed7-4f0c-bb39-3b5358bab16c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.401420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a6e64-3ed7-4f0c-bb39-3b5358bab16c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.402823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 132/267] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:04.408193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef111-6b3a-4c28-bb47-12d368cc7386 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.408500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef111-6b3a-4c28-bb47-12d368cc7386 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.408745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef111-6b3a-4c28-bb47-12d368cc7386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.426072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f67ef111-6b3a-4c28-bb47-12d368cc7386 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:04.427311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f67ef111-6b3a-4c28-bb47-12d368cc7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:04.429640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:04.496674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:04.500098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 133/268] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:04.504199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0edc-4fb4-4ead-ac44-7e96e9a9fb5e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.504487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0edc-4fb4-4ead-ac44-7e96e9a9fb5e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.504763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0edc-4fb4-4ead-ac44-7e96e9a9fb5e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.506161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 134/269] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:04.513460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.513740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.514018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.524876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.526306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.552554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:04.556734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:04.671006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 135/270] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:04.672552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.702394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 136/271] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:17:04.702394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.771402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:04.782325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c5e2b-2017-4144-966c-24d9f168efa1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.810346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:04.812581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d9931-7787-4cc4-a6a6-d7f8f401e110 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.820671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.821823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.822307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.822819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.834508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:04.843319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:04.844190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:04.844955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:04.847751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 136/272] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:04.848853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.854117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.854974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.855256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.855526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.857069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.858597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.860282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 137/273] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:04.861082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.969065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200421-fa59-41f1-b033-5efa29e1bcaa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.989482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c7e4-81a8-4c0b-b406-a75a47d551dc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.006331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.007777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.008233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.008679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.010473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.012621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.015283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 137/274] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:05.016622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.023337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.024016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.024302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.024571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.025316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:05.025619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.027020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bbbcf-1119-40a8-9fea-e781a7309e01 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.028379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.037455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 138/275] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:05.038519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f2ae-c2a2-480c-b431-be3c60a77db4 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.038822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f2ae-c2a2-480c-b431-be3c60a77db4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.039126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f2ae-c2a2-480c-b431-be3c60a77db4 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.042810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 139/276] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:05.042810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f2ae-c2a2-480c-b431-be3c60a77db4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.085598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.131383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626dd78-dbfe-42cd-9a0e-10552ca6d978 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.156384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f2ae-c2a2-480c-b431-be3c60a77db4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.164602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.165274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.165539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.165814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.166521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.167998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.189211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 138/277] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:05 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:05.190018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.198176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.198923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.199207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.199481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.200337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=ea82666acd254d4aab947bdba48e2885) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:05.200716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.202370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f57ca-b20e-4bf8-b378-659367aaff13 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.210051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 140/278] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/role_assignments?user.id=ea82666acd254d4aab947bdba48e2885&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:05.211489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.211777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.212053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.231205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:05.232520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:05.298905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.314699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053486-002f-40d3-b20d-85047cf6e0db None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.315801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 141/279] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:05.331837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.338680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.363160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.364081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.364363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.364979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] PATH_INFO: `/v3/users/a245de5e2fc84539b17f50f4c7ac15b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.381659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] RBAC: Authorizing `identity:get_user(user_id=a245de5e2fc84539b17f50f4c7ac15b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.383231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.385199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 139/280] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/users/a245de5e2fc84539b17f50f4c7ac15b1 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:05.394002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.531502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7358800-2173-4b00-92e4-aaf72a133dd1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.554444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bda0-8f44-4e9b-88bc-50f7295d3578 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.578559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.580011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.580300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.581104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.594564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:05.597356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.598197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.598623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.599070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.600052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, user.id=a245de5e2fc84539b17f50f4c7ac15b1, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:05.600527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.602129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:05.602713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:05.604519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:05.605490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 142/281] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:05.610194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.612321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 140/282] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/role_assignments?user.id=a245de5e2fc84539b17f50f4c7ac15b1&scope.system=all&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:05.673767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.732199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14549-9b1b-42b0-9b08-f9dbc2bda9e6 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.772581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.773307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.773592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.773873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.774656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:05.774999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.776420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882c98f-c9fa-4b6f-a624-4f5cdc986bb1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.790959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 143/283] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:05.793547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.836485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.912863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2468a-ae8c-4d50-a9bb-fdf13514ff44 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.913492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2468a-ae8c-4d50-a9bb-fdf13514ff44 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.913708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885a7a-5662-4f13-b4c8-34768bb77163 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.914188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2468a-ae8c-4d50-a9bb-fdf13514ff44 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.916070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 144/284] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:05.921528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.922070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.922561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.949310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:05.953925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:05.978164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.979493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.980967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.981447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] PATH_INFO: `/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.984420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] RBAC: Authorizing `identity:get_user(user_id=80ea62ed25e74f8fb69b3e2a8d76af8f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.987478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.990319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 141/285] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:05.996343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.105161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 145/286] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:06.137611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36017-2920-4b41-a899-8d792bac2649 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.154578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.166506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.192819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.193712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.193991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.194260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.198274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.199764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.201563 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 142/287] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:06.208598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.247794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.313379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c119ab-6878-4dd0-92cb-9ee12ba4918c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.365811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d321d5-4b18-48e6-9d27-7977331eebb7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.396498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.397343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.397629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.397937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.413758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.415587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.416059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/80ea62ed25e74f8fb69b3e2a8d76af8f/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.419175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, user_id=80ea62ed25e74f8fb69b3e2a8d76af8f, role_id=3d16ac40dc2d4f6cbe1bfe8a81335dff)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.422567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.423306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:06.437162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:06.438185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:06.438971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:06.440116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 146/288] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:06.444886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.453949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 143/289] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:06 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/users/80ea62ed25e74f8fb69b3e2a8d76af8f/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:06.579387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4346c1-c895-46aa-9423-d39b915b79dd None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.581525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.625621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.626661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.627171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.627642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.628596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.629118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.630817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.643904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 147/290] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:06.649318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.689301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.784874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414686ef-5664-42c1-8e36-cb1b5c79ebce None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.835780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.836682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.836966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.837243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] PATH_INFO: `/v3/users/6e8350434bd34ed78ebf2282c32e9912` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.838470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] RBAC: Authorizing `identity:get_user(user_id=6e8350434bd34ed78ebf2282c32e9912)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.839968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.841653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 144/291] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/users/6e8350434bd34ed78ebf2282c32e9912 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:06.847424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.979229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928685e-f4e8-466e-8bf7-544f057a0f4d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.014055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.014726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.015030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.015307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.046896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.088796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.090285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.189832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 148/292] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:07.195550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.295247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.303970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c53a-ad04-462d-96a3-8af3a7ca4101 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.352688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.353982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.354468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.354971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.359501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.361241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0719d3c-847c-4e7a-9b36-a7778682dedb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.363205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 145/293] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:07.369247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.462280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.516513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ecf-4c80-4607-8339-8ddc8caaf964 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.564911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.565496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.565773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.566040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.566900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=6e8350434bd34ed78ebf2282c32e9912) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:07.567210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.568662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2a6b9-8413-4522-88fd-e76333637a1d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.579808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 149/294] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/role_assignments?user.id=6e8350434bd34ed78ebf2282c32e9912&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:08.000128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40973-45c9-4dfb-bdf0-ec02cb7c05db None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.001159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40973-45c9-4dfb-bdf0-ec02cb7c05db None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.001676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40973-45c9-4dfb-bdf0-ec02cb7c05db None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.003296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 146/295] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:08.009963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.010474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.010993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.028262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:08.029825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:08.080630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648924-55b6-4ddd-99eb-460b3df58324 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.081220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648924-55b6-4ddd-99eb-460b3df58324 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.081456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648924-55b6-4ddd-99eb-460b3df58324 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.082760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 147/296] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:08.087863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.088153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.088434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.106470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:08.107224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:08.118896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 150/297] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:08.139733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.177167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 148/298] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:08.199812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.208044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.261643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff45aeb-c3d3-44b2-9b74-57cd2dec005e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.296633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.297455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.297736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.298009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.299204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.300672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b81cc-0580-4198-9051-3b6e5b1afa49 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.306631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 151/299] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:08.306631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b335-5cc4-42b3-8c38-aa7fcb35f73c None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.306631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b335-5cc4-42b3-8c38-aa7fcb35f73c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.306631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b335-5cc4-42b3-8c38-aa7fcb35f73c None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.306631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 152/300] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:08.308848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.310093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2b335-5cc4-42b3-8c38-aa7fcb35f73c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.316032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad71b-738f-45bc-b9a3-c38fb1b0f510 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.352467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.353288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.353573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.353847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.365696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-84c0e296-1deb-4e1d-8afe-9b0167a1d441 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:08.374154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:08.375245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 149/301] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:08.379560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.380251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.380251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.395113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:08.396316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:08.427521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2b335-5cc4-42b3-8c38-aa7fcb35f73c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.454672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.464324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 150/302] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:08.465552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.471596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.472714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.473408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.473887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] PATH_INFO: `/v3/groups` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.475398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.477516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.497364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 153/303] 10.222.0.57 () {60 vars in 1134 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:08.499866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.578437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.597836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cd1c-2db7-4bbc-a42a-7baf9546585a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.626544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc5d52-f00f-4490-b88f-7e26f02af350 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.637110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.638222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.638740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.639265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.640255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:08.640769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.642401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.652029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 151/304] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:08.657779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.676614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.677406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.678630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.693587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:08.703947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:08.704823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:08.705594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:08.708251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 154/305] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:08.714350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.787822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.793706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46e10-48f3-485c-b5ee-d5adc1c69c3f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.836561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.837560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.837941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.838316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] PATH_INFO: `/v3/users/a845306761e347289d771757221f2e0e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.853083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] RBAC: Authorizing `identity:get_user(user_id=a845306761e347289d771757221f2e0e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.854591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0dba0-5f8f-4e0f-86cd-98c92564911a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.856010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab7ee-5d3d-4183-a420-93d99a5ce3e2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.856548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 152/306] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/users/a845306761e347289d771757221f2e0e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:08.857875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2470-2f73-4cb4-8aa5-191d571bf1fd None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.858166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2470-2f73-4cb4-8aa5-191d571bf1fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.858443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2470-2f73-4cb4-8aa5-191d571bf1fd None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.859710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 153/307] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:08.866956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2470-2f73-4cb4-8aa5-191d571bf1fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.871268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.893675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.894385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.894640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.894952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.895714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:08.896023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.897636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1994fa-7fd5-4669-b67b-ad173c7909c4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.906418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 155/308] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:08.912281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.912568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.912849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.929715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:08.930940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:08.988941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2470-2f73-4cb4-8aa5-191d571bf1fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.999727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 156/309] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:09.003073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.037190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.037855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.038136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.038407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.039279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, user.id=a845306761e347289d771757221f2e0e, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:09.040299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.041039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.045712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.046721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 154/310] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/role_assignments?user.id=a845306761e347289d771757221f2e0e&scope.system=all&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:09.056204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.117579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbeb10-7fc8-4140-b405-0c6f518fe592 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.162199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.175349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.178429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.179278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.179893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] PATH_INFO: `/v3/users/a245de5e2fc84539b17f50f4c7ac15b1` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.182240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] RBAC: Authorizing `identity:get_user(user_id=a245de5e2fc84539b17f50f4c7ac15b1)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.184457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.187632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 157/311] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:08 2022] GET /identity/v3/users/a245de5e2fc84539b17f50f4c7ac15b1 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:09.194927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.209813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f656ac-56de-49b7-a301-c5f774351f1e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.264120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.265203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.265486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.265759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.283737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:09.297342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:09.298308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:09.299299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:09.302856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 155/312] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:09.305194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.318933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130054-b398-4666-97a9-57d87fd40aac None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.327601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.356998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.357946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.358224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.358504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] PATH_INFO: `/v3/system/users/a245de5e2fc84539b17f50f4c7ac15b1/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.360131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a245de5e2fc84539b17f50f4c7ac15b1, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.361590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.383441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 158/313] 10.222.0.57 () {58 vars in 1334 bytes} [Fri Jul 15 19:17:09 2022] PUT /identity/v3/system/users/a245de5e2fc84539b17f50f4c7ac15b1/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:09.451576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc802-eb32-46bf-abc9-b660d1cc28d5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.486621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.495874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.497085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.497949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.498227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.499027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:09.499727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.501146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.511833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 156/314] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:09.518404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.631899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d533c9-d95e-46fb-8d08-80bd14a698a8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.666369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.667259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.667607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.667890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] PATH_INFO: `/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.669134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=80ea62ed25e74f8fb69b3e2a8d76af8f)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.670613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.672821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 159/315] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/users/80ea62ed25e74f8fb69b3e2a8d76af8f => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:09.678001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.784855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555eb6-e270-49d7-b82d-a11a031c864a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.820174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.820835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.821121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.821394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.886569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.898478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.899987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.005527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 157/316] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:10.011313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.051086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.113636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a419ae-a6d7-4122-974a-10e5171cc6c0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.152233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.153125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.153434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.153760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.155013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.156477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e03e-9b40-418d-8284-0ae636b64d80 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.158600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 160/317] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.164265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.262403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.272892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0f29d-df97-43ca-8c3f-150b8f393742 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.307531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.308194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.308470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.308743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.309566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, scope.project.id=b548a45cb7d34a1aa3b4212800664b22, user.id=80ea62ed25e74f8fb69b3e2a8d76af8f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:10.309962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.311431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a490fe-6b1f-42f9-86e1-595cbe4005da None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.317690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 158/318] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/role_assignments?user.id=80ea62ed25e74f8fb69b3e2a8d76af8f&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.640833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae354-a6e2-4170-87f2-618eebdb6ab2 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.641380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae354-a6e2-4170-87f2-618eebdb6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.641380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae354-a6e2-4170-87f2-618eebdb6ab2 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.642952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 161/319] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:10.648132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.648424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.648711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.665680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:10.666942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:10.736956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 159/320] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:10.759082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae354-a6e2-4170-87f2-618eebdb6ab2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.872796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae354-a6e2-4170-87f2-618eebdb6ab2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.879958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.908726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.909463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.909727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.910014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.911226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.912678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ace3cd-45cc-4d95-ab6e-789fdac936d5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.914478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 162/321] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.920112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.004079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.021840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c52a6-0773-47d0-9202-2664d7f31300 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.056722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.057405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.057689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.057966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] PATH_INFO: `/v3/groups` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.058672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.060255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e9be-9d52-45f0-8df7-86847dc97a95 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.076834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 160/322] 10.222.0.57 () {60 vars in 1134 bytes} [Fri Jul 15 19:17:10 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:11.166223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c21fb-a01d-4e02-ae7e-a0263ce97cea None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.166427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c21fb-a01d-4e02-ae7e-a0263ce97cea None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.166659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c21fb-a01d-4e02-ae7e-a0263ce97cea None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.168299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 163/323] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:11.174008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26f7c-95fc-441c-81da-e1fd045931b4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.174521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26f7c-95fc-441c-81da-e1fd045931b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.174521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26f7c-95fc-441c-81da-e1fd045931b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.192522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-95e26f7c-95fc-441c-81da-e1fd045931b4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:11.193752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-95e26f7c-95fc-441c-81da-e1fd045931b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:11.268672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 161/324] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:11.290653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c21fb-a01d-4e02-ae7e-a0263ce97cea None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.396414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c21fb-a01d-4e02-ae7e-a0263ce97cea None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.433633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.434440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.434759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.435113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.446926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:11.455172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:11.456411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:11.457168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 164/325] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:11.461368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a9bf-e9e7-4c0e-95b4-8eb9db1341a5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.461663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a9bf-e9e7-4c0e-95b4-8eb9db1341a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.461941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a9bf-e9e7-4c0e-95b4-8eb9db1341a5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.463723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 162/326] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:11.463996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.469071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.469379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.469664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.491551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:11.492948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:11.513694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.585155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 163/327] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:11.601659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37f3b5-0a4f-449b-b057-9bb2ccb426ce None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.610661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.620925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.657257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.658978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.659411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.660130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.661035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.661486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.664022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.674989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 165/328] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:11.681085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.755467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423daf9-323a-40fc-b511-cb8a3e61b64d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.808870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.811633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.812491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.812774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.813057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.815342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a408d-1530-4858-a076-08b42b640b64 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.839796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:11.847977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:11.848847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:11.849618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 164/329] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:11.851614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.852568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.852859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.853135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] PATH_INFO: `/v3/users/a845306761e347289d771757221f2e0e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.854731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] RBAC: Authorizing `identity:get_user(user_id=a845306761e347289d771757221f2e0e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.855252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.856384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.858361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 166/330] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/users/a845306761e347289d771757221f2e0e => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:11.863892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.959859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.976332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def1399-4385-4b1c-a349-ce16ad53c513 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.012495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.013405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.013684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.013960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] PATH_INFO: `/v3/system/users/a845306761e347289d771757221f2e0e/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.015590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a845306761e347289d771757221f2e0e, role_id=3d16ac40dc2d4f6cbe1bfe8a81335dff)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.017065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.026236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 167/331] 10.222.0.57 () {58 vars in 1334 bytes} [Fri Jul 15 19:17:11 2022] PUT /identity/v3/system/users/a845306761e347289d771757221f2e0e/roles/3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:12.028578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9b9a-25fb-4d1a-a1cd-57e3fe620679 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.072807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.073886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.074434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.074977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.076134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:12.076641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.078294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.089458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 165/332] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:12.095794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:12.130077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:12.216999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603e02-1546-4c76-85b6-15193af48590 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.253237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49586e75-4c22-4371-b208-3c471732208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.254512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586e75-4c22-4371-b208-3c471732208b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.255033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586e75-4c22-4371-b208-3c471732208b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.255535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586e75-4c22-4371-b208-3c471732208b None admin] PATH_INFO: `/v3/users/a245de5e2fc84539b17f50f4c7ac15b1` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.256945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49586e75-4c22-4371-b208-3c471732208b None admin] RBAC: Authorizing `identity:get_user(user_id=a245de5e2fc84539b17f50f4c7ac15b1)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.258743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49586e75-4c22-4371-b208-3c471732208b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.260972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 168/333] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:12 2022] GET /identity/v3/users/a245de5e2fc84539b17f50f4c7ac15b1 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:12.267335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:12.380575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0c57-bb1e-4050-bc39-69ad9612d25c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.412460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:12.423282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.424255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.424734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.425228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.426266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] RBAC: Adding query filter params (role.id=8a808717b2bd475fa487b6efe8f100ba, user.id=a245de5e2fc84539b17f50f4c7ac15b1, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:12.426811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.428517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7d68b-cf5a-4a14-ab9e-084648ef5deb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.443179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 166/334] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Jul 15 19:17:12 2022] GET /identity/v3/role_assignments?user.id=a245de5e2fc84539b17f50f4c7ac15b1&scope.system=all&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:13.495012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8d2de-cf43-41bb-bccc-1232fd7edfeb None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.495536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8d2de-cf43-41bb-bccc-1232fd7edfeb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.495536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8d2de-cf43-41bb-bccc-1232fd7edfeb None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.497191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 169/335] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:13.504127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af7d6-7463-4a41-9640-44d7fa47dc45 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.504572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af7d6-7463-4a41-9640-44d7fa47dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.504766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af7d6-7463-4a41-9640-44d7fa47dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.531856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3c8af7d6-7463-4a41-9640-44d7fa47dc45 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:13.533077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3c8af7d6-7463-4a41-9640-44d7fa47dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:13.617504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 167/336] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:13.651662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8d2de-cf43-41bb-bccc-1232fd7edfeb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.704547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf910-7018-45b4-b9d8-b179c0a78920 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.704872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf910-7018-45b4-b9d8-b179c0a78920 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.705097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf910-7018-45b4-b9d8-b179c0a78920 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.707127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 168/337] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:13.711951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.712235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.712510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.738824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:13.741159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:13.857505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:13.873908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 169/338] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:13.875614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8d2de-cf43-41bb-bccc-1232fd7edfeb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:13.944220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.944439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:13.945303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.945591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.945868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.973813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:13.983224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:13.984126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:13.984896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 170/339] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:13.990366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.033729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.177016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45d582-2b8c-4b42-9869-e0bae857a815 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.206973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e88b6-24d5-4335-94ed-c2d8452b5d53 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.248559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.249821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.250290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.250579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.257785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.258561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.258947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.260530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.261360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:14.261680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.263507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.272859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 171/340] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:14.276580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:14.278976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:14.297523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:14.298466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:14.299281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 170/341] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:14.307982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.339189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.529826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b839e-2697-494d-bba8-1ce0b810d5f2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.538174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656750-d134-4da1-81fa-b8278034ae26 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.551104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.582412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.583138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.583425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.583707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.585010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:14.585338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.586973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a31dd-612f-46ee-b081-ca1b05d2b2d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.595673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 171/342] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:14.597751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac441-290f-44a9-bb6d-c0c48a444026 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.598071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac441-290f-44a9-bb6d-c0c48a444026 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.598355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac441-290f-44a9-bb6d-c0c48a444026 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.599916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 172/343] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:14.604888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac441-290f-44a9-bb6d-c0c48a444026 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.644036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.644715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.645003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.645270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.763056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.764540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8ef7-6739-4fa5-9959-1ee916db4b42 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.785400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac441-290f-44a9-bb6d-c0c48a444026 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.816530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.861553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.862222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.862499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.862766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.931141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.959740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 172/344] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:17:14.959740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.959740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.959740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.991271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.991471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:14.992561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:14.993355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.115039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 173/345] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:15.115832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.190811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 173/346] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:15.192461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.240551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.295136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.350596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943d4e-4b0a-4318-9674-58b1c5c0a680 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.384890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82f74-aacc-4306-949d-1a0f37b65de6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.397063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.397894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.398178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.398447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.415799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:15.426071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:15.427061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:15.427914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:15.429258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 174/347] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:15.429258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.433337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.434251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.434633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.434904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.436238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.437810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65242-6ef8-46c7-8843-7bb44a1c2a54 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.439582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 174/348] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:15.440868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab9aa-f23d-413e-ad6b-6366466d86a2 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.441151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab9aa-f23d-413e-ad6b-6366466d86a2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.441433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab9aa-f23d-413e-ad6b-6366466d86a2 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.442721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 175/349] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:15.443452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eab9aa-f23d-413e-ad6b-6366466d86a2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.546793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c9979-aac5-4be9-b3fb-a2b2d2e813aa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.555231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eab9aa-f23d-413e-ad6b-6366466d86a2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.573923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.576945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.587569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.588572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.589717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.591322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.593523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.595129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.597237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 175/350] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:15.597909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.598032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.598583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.598926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.599207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.599965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:15.600275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.601664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94942bb4-7d20-4c9f-ae71-7e0907add880 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.612824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 176/351] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:15.614470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11b71-8eba-428d-8ac1-3fd82f6af4f0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.615014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11b71-8eba-428d-8ac1-3fd82f6af4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.615491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11b71-8eba-428d-8ac1-3fd82f6af4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.634456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1bb11b71-8eba-428d-8ac1-3fd82f6af4f0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:15.635768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1bb11b71-8eba-428d-8ac1-3fd82f6af4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:15.719621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 177/352] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:15.721035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde615fd-395b-4121-b406-cdbd9d992d26 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.721332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde615fd-395b-4121-b406-cdbd9d992d26 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.723465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde615fd-395b-4121-b406-cdbd9d992d26 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.723991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 178/353] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:15.724744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde615fd-395b-4121-b406-cdbd9d992d26 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.730081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6f91-6c7a-4bb3-8b58-40166c3cd8b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.767357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.768246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.768524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.768795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.775192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.776646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.778536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 176/354] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:15.780147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.852629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde615fd-395b-4121-b406-cdbd9d992d26 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.864836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.867865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.898115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.899054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.899342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.899619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.900812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.902286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f2179-0a75-43c1-adb3-f06dbc6a9d5e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.908964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 179/355] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:15.908964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.908964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.908964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.915307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db55b7-7b89-4f5c-8e11-53596c9b730e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.923595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:15.925740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:15.954760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.956249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.956535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.956813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.005832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 180/356] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:16.006517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.042580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.044193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.112455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.132337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f22228-26ca-4716-9dbd-212b76efbdc5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.140440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.161914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 177/357] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:16.163017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.177946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.179325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.179612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.179882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.192728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5ec8561b-ad3f-48f6-9b9b-267e46976173 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:16.200811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:16.201667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:17:16.203010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:16.206910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 181/358] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:16.208310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bf0-bc89-4edf-b8a9-34d97dfbea66 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.208599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bf0-bc89-4edf-b8a9-34d97dfbea66 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.209097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bf0-bc89-4edf-b8a9-34d97dfbea66 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.210471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 182/359] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:16.211273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5bf0-bc89-4edf-b8a9-34d97dfbea66 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.275933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54c0c9-0ead-4beb-a6e0-f99e1ab54ce4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.316517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.316517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.317269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.317269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.317915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.318327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.319717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.326711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 178/360] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.327523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.338023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5bf0-bc89-4edf-b8a9-34d97dfbea66 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.363972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.387754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.388463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.388738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.389008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.389876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.390187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.391718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.400385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 183/361] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.401491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.471419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.480067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ec73-0c34-4c3a-8bf3-1ba84a0e94ea None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.528814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.529858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.530217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.530572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.535026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bdee-f99e-495e-a5c2-cd4cfbbbf3f1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.547982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:16.558618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:16.559627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:16.560577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 179/362] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:16.561214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.598024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.599923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.600408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.601327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.603469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.605041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576f148-02f6-44ae-a90c-4ecf8d57feb9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.607970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 184/363] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.609193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.611104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.611401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.638073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:16.639359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:16.675112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.703467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e97-c6f3-4f57-8dcd-0cc8a11c87c7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.729006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 185/364] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:16.729664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.744834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.745530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.745812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.746087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.746875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.747335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.748917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.757851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.762582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 180/365] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.763689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.833975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d469f-9cd3-4538-92f1-a20d3a2b581b None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.869673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.870298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.870577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.870877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.871628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.871963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.873541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.879784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5aba2-5c00-436f-a7ce-e3c7033602d9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.886726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 186/366] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.886726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.923705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.925007 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.925483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.925973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.927418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.929179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.931521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 181/367] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.932700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.956164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.986444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.996653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e640-b529-4137-aca8-cf86b17de520 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.032192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.033061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.033274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.033544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.045362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:17.053096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:17.053957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 187/368] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:17.055166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.060222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca6ce-b403-4d22-82d1-b748faacfef3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.097076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.099108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.099622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.100118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] PATH_INFO: `/v3/users/a845306761e347289d771757221f2e0e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.101605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=a845306761e347289d771757221f2e0e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.103354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.105428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 182/369] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/users/a845306761e347289d771757221f2e0e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.106580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.183068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efd46b-78e1-414e-9c65-9f6857d8f4d7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.201972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.225411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e93a6-d34b-430b-9ab8-b22f4b7a2fc3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.229181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.229726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.230007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.230277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.253922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.268909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.270049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.270336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.270614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.271559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=b548a45cb7d34a1aa3b4212800664b22) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:17.271921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.273427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.284931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 183/370] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.286826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.329441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.331488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.460281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 188/371] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:17.461571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.519050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7cd-5db3-485e-b57f-a0f387d9eb56 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.527163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.566749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.568161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.568668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.569211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.570210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:17.570713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.572341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.581792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 184/372] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.582838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a056d-ef94-4fbb-9bf4-e1b8c930d71c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.583162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.596821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.636355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.638321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.638947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.639419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.640453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] RBAC: Adding query filter params (role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff, user.id=a845306761e347289d771757221f2e0e, scope.system=all) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:17.640979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.643551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.661438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 189/373] 10.222.0.57 () {56 vars in 1308 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/role_assignments?user.id=a845306761e347289d771757221f2e0e&scope.system=all&role.id=3d16ac40dc2d4f6cbe1bfe8a81335dff => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.667320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.738502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b3644-12ff-4bc3-9e74-31bb6eadb67a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.780143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.781003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.781312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.781550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.782775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.785117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.786918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 185/374] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.792993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.824446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b461d1-8e46-4364-95a5-8f30c55023d9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.836156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.876119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.876815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.877101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.877936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.953901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.982869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.984396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.007458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a1de-c83d-498d-b2c5-12ba692fec10 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.068743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.069560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.069846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.070121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.071500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.073089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.075264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 186/375] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:18.081797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.100661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 190/376] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:18.107793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.117782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.220104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a27d-2c21-4ab2-b290-c75facc67ba2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.263601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.264326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.264608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.264880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.265720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=b548a45cb7d34a1aa3b4212800664b22) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:18.266033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.267510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.273892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 187/377] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:18.310979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad9c-45f7-4110-b641-593f45a26d40 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.366269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.367111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.367391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.367664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] PATH_INFO: `/v3/projects/1d82d6637d8c4815a3aaa31f204adffe` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.371654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] RBAC: Authorizing `identity:get_project(project_id=1d82d6637d8c4815a3aaa31f204adffe)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.373243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.375126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 191/378] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/projects/1d82d6637d8c4815a3aaa31f204adffe => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:18.380942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.394406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.551749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff244c-e66d-416d-ae14-ed838f02d180 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.592565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.593449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.593731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.594004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] PATH_INFO: `/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.599341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] RBAC: Authorizing `identity:get_group(group_id=77fa92bb33e24e59a489dfcf2b4107fe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.600832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468434-4755-4f6d-90be-a12caa45414d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.602835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 188/379] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:18.608917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.699016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.736606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee500-7c4c-45d8-9e30-13af9904d55c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.782838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.782838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.782838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.782838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.783237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] RBAC: Adding query filter params (group.id=77fa92bb33e24e59a489dfcf2b4107fe, role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=1d82d6637d8c4815a3aaa31f204adffe) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:18.783237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.783237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecebc-9af2-41a2-8dae-97e78989d539 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.791702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 192/380] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/role_assignments?group.id=77fa92bb33e24e59a489dfcf2b4107fe&scope.project.id=1d82d6637d8c4815a3aaa31f204adffe&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.102457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f302d6-7ce3-4dec-885d-3a87527afd60 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.102719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f302d6-7ce3-4dec-885d-3a87527afd60 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.103008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f302d6-7ce3-4dec-885d-3a87527afd60 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.104363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 189/381] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:19.110369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.110666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.110978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.120845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9def5-b949-40f6-8990-3d3c1244d20d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.121148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9def5-b949-40f6-8990-3d3c1244d20d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.121404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9def5-b949-40f6-8990-3d3c1244d20d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.123116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 190/382] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:19.131355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:19.132242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.132532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.132641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:19.132814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.163080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:19.164299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:19.261444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 193/383] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:19.277325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.283210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 191/384] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:19.290137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.306304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.418624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.431233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749da0-ad5a-4c01-99fc-1743ace721f7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.473110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.474102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.474485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.474604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793f82c-2b69-40c8-b509-d3b8f70c1078 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.474968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.487420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:19.495513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:19.496424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:19.497286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 192/385] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:19.508008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.543610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.544608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.544894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.545165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.560035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:19.572394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:19.574462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:19.576380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:19.577831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.577971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 194/386] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:19.587186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.627056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619f93d-089c-4c63-b123-c2a6dd6e267a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.663291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.664323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.664776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.665252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.666155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:19.666700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.668273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.678386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 193/387] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.683641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.788954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd074d-0063-4537-88f5-90367997c789 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.800797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abe4b-5d5b-4c86-bdf9-dedbc37c604c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.826908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.847117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.848253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.848698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.849123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.851600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.853084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.855081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 194/388] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.859332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.860451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.872245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.874423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.875447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.876947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.877875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:19.878657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.881689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.898097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 195/389] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.904295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.993016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b395-830a-4d6c-a5ea-f0c0047761e9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.029902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.031402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.031855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.032270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.033645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.035288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.038149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 195/390] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:20.043598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.133792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db433d-e584-4ba0-b89b-732364cc35c7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.159202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.187099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.188281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.188724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.189136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.191452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.193065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.195932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 196/391] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:20.202337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.241687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4190d1-0d8f-47ae-87fc-26aeffe98b91 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.280546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.290021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.291817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.292580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.293079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/groups/498af085fbe74b53bedfb65ca50c783e/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.296575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, group_id=498af085fbe74b53bedfb65ca50c783e, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.298500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e0e3-d49d-4a0e-85b0-02909914542a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.318372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 196/392] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Jul 15 19:17:20 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/groups/498af085fbe74b53bedfb65ca50c783e/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:20.320483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3420-5ce2-4809-b7ed-9d684ca5e618 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.321572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3420-5ce2-4809-b7ed-9d684ca5e618 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.322353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3420-5ce2-4809-b7ed-9d684ca5e618 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.325317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 197/393] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:20.333667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbba23-98b7-449c-9891-e62500730dd7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.335368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.335693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.335974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.367830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:20.369351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:20.407076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.407991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.408269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.408542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.415762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.417262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.419584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 197/394] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:20.425000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.489181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 198/395] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:20.506226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.581036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.585768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9ad9-4a1a-4d34-b31e-f35ffb2f3b29 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.638863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.659254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34994d3f-3656-4e6d-843c-d7817a863d1b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.668256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.669024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.669314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.669751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/groups/498af085fbe74b53bedfb65ca50c783e/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.679659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdc60ac624b8dabd11e0489a33ee8, group_id=498af085fbe74b53bedfb65ca50c783e, role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.681141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.697828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.698969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.699410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.700059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.711968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:20.720544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:20.721597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:20.722556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:20.723289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 198/396] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Jul 15 19:17:20 2022] PUT /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8/groups/498af085fbe74b53bedfb65ca50c783e/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:20.725029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 199/397] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:20.731113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.900733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb19aa7-66cc-45d0-a67d-b13d37c2a185 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.940835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.941519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.941850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.942132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.942924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:20.943239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.944628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852dcb4-4491-43b5-9545-30eae64e00d0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.953756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 199/398] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:20.959608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.015365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d25aa-bd2b-4cfe-b065-597e76b51f72 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.015659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d25aa-bd2b-4cfe-b065-597e76b51f72 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.015944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d25aa-bd2b-4cfe-b065-597e76b51f72 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.017579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 200/399] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:21.022471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.030986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.030986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.045744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:21.047940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:21.113937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba473d-8fb9-4dc0-8784-d1e73a9ba596 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.134808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.153052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.161107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.162675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.163033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.163768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.165148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:21.166625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:21.170001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 200/400] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:21.175606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.206494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 201/401] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:21.240921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.313403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe3a4-038f-4267-a357-d68d653e2841 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.349699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.351394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.352123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.352669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.354765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:21.357062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c251d-c458-40ac-a677-19fdae97ac66 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:21.359727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 201/402] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:21.361753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d1af-d23a-4222-804e-346e13619279 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.362258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d1af-d23a-4222-804e-346e13619279 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.362727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d1af-d23a-4222-804e-346e13619279 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.368387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 202/403] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:21.368387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077d1af-d23a-4222-804e-346e13619279 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.380906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dbffb-1fea-494b-9d09-81d46bc25083 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.416275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.417444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.417914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.418383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.429287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:21.431237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c5fdd5a1-7270-4fb0-afd4-3a4f00d9e66c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:21.438264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:21.439163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:21.439944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:21.442614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 202/404] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:21.444194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.444685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.445244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.467733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:21.469202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:21.513045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.514651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077d1af-d23a-4222-804e-346e13619279 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.554210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.555556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.556052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.556516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/groups/498af085fbe74b53bedfb65ca50c783e/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.558261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 203/405] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:21.559081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, group_id=498af085fbe74b53bedfb65ca50c783e, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:21.559206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.561006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:21.591768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 203/406] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Jul 15 19:17:21 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/groups/498af085fbe74b53bedfb65ca50c783e/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:21.592999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.756826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863c09-b933-47be-a6a9-d8bcf401e22d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.807861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8056d-ed68-4e95-960d-eca660b181ef None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.810624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.812311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.813058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.813341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.813612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.814374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:21.814687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:21.816141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:21.827923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 204/407] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:21.834772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.848112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.848933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.849212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.849487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.860839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:21.866753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:21.869767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:21.877383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:21.878144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 204/408] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:21.880240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.974002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a8ba7-ff3b-43b9-b2b7-a78818c2c039 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.016760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507ac8a-9fbc-442c-a0ca-6bb710b6159c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.053734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.054840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.055326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.055797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.056756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:22.057350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.059005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.069267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 205/409] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:22.073607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.073607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.073607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.073607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.074244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.075752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.076156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.077658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 205/410] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:22.083075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.106700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.181426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8450f0-436f-40a3-aa75-305a3cecb72b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.217106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.218367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.218905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.219378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] PATH_INFO: `/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.220844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] RBAC: Authorizing `identity:get_group(group_id=77fa92bb33e24e59a489dfcf2b4107fe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.222601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.224776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 206/411] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:22.230467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.293926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.299558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a17c-5059-42e9-9c00-9cb323e0498e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.331674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.338446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2cc0c-59fd-4c69-be5c-f1ae43d81ca5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.359391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.360288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.360567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.360838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.363581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.365073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.370457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 206/412] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:22.372651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.378648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.379820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.380319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.380786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] PATH_INFO: `/v3/projects/1d82d6637d8c4815a3aaa31f204adffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.382295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] RBAC: Authorizing `identity:get_project(project_id=1d82d6637d8c4815a3aaa31f204adffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.383985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.386192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 207/413] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/projects/1d82d6637d8c4815a3aaa31f204adffe => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:22.392159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.499982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13242-1212-4de9-b831-7cdd95490c9b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.536122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.537508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.538015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.538506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] PATH_INFO: `/v3/projects/1d82d6637d8c4815a3aaa31f204adffe/groups/77fa92bb33e24e59a489dfcf2b4107fe/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.540865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] RBAC: Authorizing `identity:create_grant(project_id=1d82d6637d8c4815a3aaa31f204adffe, group_id=77fa92bb33e24e59a489dfcf2b4107fe, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.542537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f42541-ca7b-4371-9be2-78af1dea923f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.555015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e8e64-86f1-4915-ba48-d14a2eb55ffe None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.568503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 208/414] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Jul 15 19:17:22 2022] PUT /identity/v3/projects/1d82d6637d8c4815a3aaa31f204adffe/groups/77fa92bb33e24e59a489dfcf2b4107fe/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:22.613483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.614856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.615363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.615878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22/groups/498af085fbe74b53bedfb65ca50c783e/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.618498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] RBAC: Authorizing `identity:create_grant(project_id=b548a45cb7d34a1aa3b4212800664b22, group_id=498af085fbe74b53bedfb65ca50c783e, role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.620443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acfb4c-0586-42a4-b828-c823eb901c42 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.636573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 207/415] 10.222.0.57 () {58 vars in 1442 bytes} [Fri Jul 15 19:17:22 2022] PUT /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22/groups/498af085fbe74b53bedfb65ca50c783e/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:22.719503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a468de-6d31-4265-bd15-0fb4233a5744 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.719860 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a468de-6d31-4265-bd15-0fb4233a5744 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.720063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a468de-6d31-4265-bd15-0fb4233a5744 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.721709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 209/416] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:22.727332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.727611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.727902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.755441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:22.756736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:22.788818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.847206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 208/417] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:22.870399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a468de-6d31-4265-bd15-0fb4233a5744 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.898147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.995301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a468de-6d31-4265-bd15-0fb4233a5744 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.030704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.031561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.031849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.032126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.043007 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-07deb8c9-eb9d-4ed9-bc04-1ca4842abc24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:23.050969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:23.051852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:23.052627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 210/418] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:23.058603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.101822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2cc0d-3c5b-4f33-a3e3-f47086fc4799 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.102114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2cc0d-3c5b-4f33-a3e3-f47086fc4799 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.102307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2cc0d-3c5b-4f33-a3e3-f47086fc4799 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.104468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 211/419] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:23.120464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.121126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.121607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.159849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:23.161434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:23.191406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74413721-00ba-4315-84c8-85c304c7e6d5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.245213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.246272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.247470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.248592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.250677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.253158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.254826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.275381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 209/420] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:23.278377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.318654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.323711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 212/421] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:23.346568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.367032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.462483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6707de-87ff-4206-91ad-2d095c296b0e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.530174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f536f-39fe-4260-9c32-c39530d22165 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.532259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.532933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.533213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.533489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.603876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.605009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.605296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.605573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.634589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:23.634955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.636430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:23.654339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:23.655277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:23.656048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:23.658800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 213/422] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:23.667242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.668798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.746985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 210/423] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:23.752802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.849023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.907271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa5f6-f208-4bc5-90d2-140a86475458 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.930809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381c40-042d-40d2-bd48-eccdebbf82bb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.951065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.972162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.972887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.973166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.973439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.974204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.974511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.975945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.980493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.981453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.981737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.982011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.985304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 214/424] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:23.990834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.990959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.992004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.992937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 211/425] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:24.019860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.100148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631218-22c7-4f22-a0a4-539f2686002c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.135160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.136161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.136589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.137032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.140036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.193352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5441-fd07-435e-9ddd-33bfa191a152 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.208142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.209817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cbeea-97ce-45e7-a747-08e37a846ee4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.229713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.230596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.230958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.231499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.232494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.234142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eacd88-2185-4607-8874-fa31b048d257 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.240967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 212/426] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:24.242425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec6f-9476-490f-946b-375e471f0b70 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.242650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec6f-9476-490f-946b-375e471f0b70 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.243024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec6f-9476-490f-946b-375e471f0b70 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.244506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 213/427] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:24.245313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ec6f-9476-490f-946b-375e471f0b70 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.307649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.315591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 215/428] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:24.321593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.321867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.322158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.340437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:24.341683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:24.356281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ec6f-9476-490f-946b-375e471f0b70 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.369696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.393317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.394213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.394632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.395129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.396229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:24.396680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.398254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.405208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 214/429] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:24.406213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.426023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 216/430] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:24.487597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.546096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0446-8388-484b-a902-a29b3f6abffe None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.570017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.590042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.590042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.590042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.590042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] PATH_INFO: `/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.590466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] RBAC: Authorizing `identity:get_project(project_id=7eecdc60ac624b8dabd11e0489a33ee8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.591413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.593894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 215/431] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/projects/7eecdc60ac624b8dabd11e0489a33ee8 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:24.600208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.681909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450487f6-27ea-426f-853f-73f569c41ba2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.719549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2b82-a301-4f5c-8d30-82cdcd01f509 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.724426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.725261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.725545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.725823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.738102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:24.746372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:24.747322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:24.748090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 217/432] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:24.753937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.761880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.763145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.763761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.764228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.765744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.767555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.769694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 216/433] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:24.775637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.791678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.838867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.881385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdbd5-0f18-4968-a5ee-cb8933962067 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.885852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27add0-a920-411f-8b92-cb9204427ca0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:24.917818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.919370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.919370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.919554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.920213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:24.920784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.923574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef9fc-d184-41f4-8187-6a5315b8700f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.927748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:24.928686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.929240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.929612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.930545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:24.931005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:24.932539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:24.933433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 218/434] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:24.939515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0945b-2891-45a7-981f-1c19af7cbcc6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.939749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0945b-2891-45a7-981f-1c19af7cbcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.940167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0945b-2891-45a7-981f-1c19af7cbcc6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.940421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 217/435] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=7eecdc60ac624b8dabd11e0489a33ee8&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:24.941245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:24.941848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 219/436] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:24.947449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.947859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.948199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.973567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:24.974829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:25.058843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 220/437] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:25.076910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e103-5ed1-4f5e-8014-ee7c8a971cc9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.082974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.104159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.106272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.124014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.124221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.124477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.124635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.209207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.211039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea619f-1dd1-43df-abef-50b0a69c211b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.218650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59aa13-21ad-4551-8fc9-0a0d38fe3317 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.260772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.261949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.263053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.263053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.276699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1e77c1b8-8e90-4167-bea2-7b1986f48219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:25.284587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:25.285495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:25.286434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 221/438] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:25.287390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c17e2-29f8-4d7a-baa7-b228220b4192 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.287663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c17e2-29f8-4d7a-baa7-b228220b4192 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.288558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c17e2-29f8-4d7a-baa7-b228220b4192 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.289347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 222/439] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:25.294344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c17e2-29f8-4d7a-baa7-b228220b4192 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.337458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 218/440] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:25.339955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.339955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.339955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.356297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:25.358049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:25.372050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.383338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.407853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c17e2-29f8-4d7a-baa7-b228220b4192 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.434803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 219/441] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:25.434803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.443664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.444006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.444286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.444559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.445311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:25.445618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.447370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.456388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 223/442] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.457591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.532628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5282f-45cf-4343-a998-aae259e91ff9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.554125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c903d-0a2c-44fb-8f76-0bbdda6393d6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.565035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.565908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.566201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.566468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.567644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.569113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.570816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 220/443] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.571565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.587591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.588346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.588629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.588905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.590218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.596133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.600949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:25.609262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:25.610307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:25.611306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 224/444] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:25.612073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.678697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda0e8-ce5c-4e7d-a61c-dfd52c3596ee None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.711312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed8db-973d-44f9-944a-67f889ad2ac6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.713144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.714083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.714083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.714385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.745428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.746296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.746575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.746972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.748194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.749647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.751315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 225/445] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.752066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.786765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.788261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.807283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.817458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.853201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11700-38e8-46b4-a651-2564b15ba601 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.887265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.887939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.888224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.888521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.888656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 221/446] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:25.889278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:25.889385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.889589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.890995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.899268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 226/447] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.900057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.992693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd298-830f-4062-9e75-dd72c2330d5d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.999817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549f90-f3ad-48cb-9497-0f942675f422 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.011596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.025943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.029685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.030326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.030605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.030915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.031746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=8a808717b2bd475fa487b6efe8f100ba, scope.project.id=b548a45cb7d34a1aa3b4212800664b22) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.032060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.033524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.034343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.035247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.035534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.035808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] PATH_INFO: `/v3/projects/1d82d6637d8c4815a3aaa31f204adffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.037006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1d82d6637d8c4815a3aaa31f204adffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.038442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.039922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 222/448] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=8a808717b2bd475fa487b6efe8f100ba => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.044607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 227/449] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/projects/1d82d6637d8c4815a3aaa31f204adffe => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.044796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.045773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.158313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5c74-5df3-45b6-9523-be8c56c26536 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.163594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d163353-3da3-4381-8999-21d4f06007d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.200748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.201456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.201637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.201919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.202121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.202212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] PATH_INFO: `/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.202401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.202675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.204188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] RBAC: Authorizing `identity:get_group(group_id=77fa92bb33e24e59a489dfcf2b4107fe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.206019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.208004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 228/450] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/groups/77fa92bb33e24e59a489dfcf2b4107fe => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:26.214112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.258281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.285925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.287777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.288138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.330923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059bdf3-8ab2-4e9b-b16a-4141cafbb2af None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.371726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.372631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.372742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.372962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.373801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] RBAC: Adding query filter params (group.id=77fa92bb33e24e59a489dfcf2b4107fe, role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=1d82d6637d8c4815a3aaa31f204adffe) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.374115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.376266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.382602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 229/451] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/role_assignments?group.id=77fa92bb33e24e59a489dfcf2b4107fe&scope.project.id=1d82d6637d8c4815a3aaa31f204adffe&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:26.419805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 223/452] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:26.425778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.535167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39fad0-7f3d-4043-87da-88fd65cc3277 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.563684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.572601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.573479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.573764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.574040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] PATH_INFO: `/v3/projects/b548a45cb7d34a1aa3b4212800664b22` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.575339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] RBAC: Authorizing `identity:get_project(project_id=b548a45cb7d34a1aa3b4212800664b22)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.576798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.578474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 230/453] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/projects/b548a45cb7d34a1aa3b4212800664b22 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.584634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.668637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.690507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4737e6-385e-4f13-9fdd-8b5fc5ab4ffa None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.729211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.730072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.730357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.730631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] PATH_INFO: `/v3/groups/498af085fbe74b53bedfb65ca50c783e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.731993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] RBAC: Authorizing `identity:get_group(group_id=498af085fbe74b53bedfb65ca50c783e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.733450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8731fd-80f1-44b0-803f-d0ed13ca27d4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.735118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 224/454] 10.222.0.57 () {56 vars in 1180 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/groups/498af085fbe74b53bedfb65ca50c783e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.741437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.855644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26338-603b-40e6-b4f8-70c9b1b5aa3e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.902085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.902746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.903062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.903336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.904167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] RBAC: Adding query filter params (group.id=498af085fbe74b53bedfb65ca50c783e, role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=b548a45cb7d34a1aa3b4212800664b22) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.904480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.905916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eca0fa-4929-4d1a-b5dd-959b94d796f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.911844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 231/455] 10.222.0.57 () {56 vars in 1376 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/role_assignments?group.id=498af085fbe74b53bedfb65ca50c783e&scope.project.id=b548a45cb7d34a1aa3b4212800664b22&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:29.613744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d709-1b14-4e91-9ecb-b1b30b5f3148 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.614645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d709-1b14-4e91-9ecb-b1b30b5f3148 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.615076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d709-1b14-4e91-9ecb-b1b30b5f3148 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.616868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 225/456] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:29.622130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb502a8-8068-4e4d-8984-6a764ae26b43 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.622562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb502a8-8068-4e4d-8984-6a764ae26b43 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.622667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb502a8-8068-4e4d-8984-6a764ae26b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.643183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dbb502a8-8068-4e4d-8984-6a764ae26b43 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:29.644407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbb502a8-8068-4e4d-8984-6a764ae26b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:29.722941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:29.739511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 232/457] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:29.769595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf5db-5ddd-466f-aeab-1a3742d11c92 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.769595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf5db-5ddd-466f-aeab-1a3742d11c92 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.769595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf5db-5ddd-466f-aeab-1a3742d11c92 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.770284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 226/458] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:29.774743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf5db-5ddd-466f-aeab-1a3742d11c92 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:29.775238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee0a1-c4a1-41cc-8f20-38060fc91450 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.775534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee0a1-c4a1-41cc-8f20-38060fc91450 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.775820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee0a1-c4a1-41cc-8f20-38060fc91450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.801701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-be9ee0a1-c4a1-41cc-8f20-38060fc91450 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:29.803180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be9ee0a1-c4a1-41cc-8f20-38060fc91450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:29.875703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 233/459] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:29.877540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6a97-575f-4d5a-99bf-2e76d1d135d1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.878063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6a97-575f-4d5a-99bf-2e76d1d135d1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.878512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6a97-575f-4d5a-99bf-2e76d1d135d1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.884039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 234/460] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:29.884916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf5db-5ddd-466f-aeab-1a3742d11c92 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:29.885864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.886240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.886606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.903792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:29.905322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:29.921583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:29.922659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.923104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.923516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.934626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:29.936280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:29.954410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:29.955320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:29.956486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:29.956486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:29.956486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:29.956486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:29.958750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 227/461] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:29.964473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:29.967629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:29.987165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 235/462] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:29.988089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.058316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.072632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848bbf0-6c69-470a-9518-58063568bdd2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.107069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.107931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.108213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.108368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194eb7-2f75-4723-b1c2-2a1210869520 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.108486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.119308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.120993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-69d790a2-c566-4d6c-8018-067b84a2f3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:30.141330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:30.142373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:30.143294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:30.143294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:30.143294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.143294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:30.143294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 228/463] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:30.144092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac88c-2967-4b7a-a155-4cd5b547cd01 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.144326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac88c-2967-4b7a-a155-4cd5b547cd01 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.144603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac88c-2967-4b7a-a155-4cd5b547cd01 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.145972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 229/464] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:30.149500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac88c-2967-4b7a-a155-4cd5b547cd01 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.155390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.156073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.156352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.156622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.157355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:30.157664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.159634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.179304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 236/465] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:30.180194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.216403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.264846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac88c-2967-4b7a-a155-4cd5b547cd01 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.285859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3e3fb-a7df-4ebe-8ffd-6fe45a1b9c59 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.296953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.301055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.301862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.302152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.302423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.313345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.314835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.325446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.326415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.326892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.327335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.328237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:30.328733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.330357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-fe7267d9-3ba9-4f60-8188-1a99c3716395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:30.332540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:30.333312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:30.334135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:30.334135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:30.334135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.334135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:30.338852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 230/466] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:30.339882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.340189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.340505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.348191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 237/467] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:30.348191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.362730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:30.363983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:30.436985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 231/468] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:30.447103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.461135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28abf-5180-463d-9b1c-9ee3e295e09e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.483030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.497951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.498640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.498959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.499236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.499946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.501406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.524210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 238/469] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:30 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:30.525316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.554433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a105d0-fcb5-42a9-ba3a-bc3b1420e634 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.569047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.595982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.596688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.596970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.597245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.598012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:30.598327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.599879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.619652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 232/470] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:30.620947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.707898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d59fb-16c1-406e-b26f-fe13e37c7ba4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.750355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.758436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a26c79-5cc8-4020-b0d8-c5c2889a1bb7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.761451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.762718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.762718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.762718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.763480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.764941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.795003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 239/471] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:30 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:30.795003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.830249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.832052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.832345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.832624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.849560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.851447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ada8dfa1-71d9-4829-b9e7-cd99ed69109a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:30.877161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:30.878317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:30.879222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:30.879222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:30.879222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:30.879222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:30.879222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 233/472] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:30.880279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7695-c9bf-48d9-8535-04eef568d031 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.880569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7695-c9bf-48d9-8535-04eef568d031 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.880847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7695-c9bf-48d9-8535-04eef568d031 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.882836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 234/473] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:30.887860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a7695-c9bf-48d9-8535-04eef568d031 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:30.911634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:30.931643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989feabf-42ab-42d2-b67b-a4ed8f8511f3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:30.977316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:30.977943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:30.978298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:30.978462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:30.979353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:30.981181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fec1-750c-4317-8c48-9015131ae285 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.009932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 240/474] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:30 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:31.010149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a7695-c9bf-48d9-8535-04eef568d031 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.011043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.011511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.011612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.034646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:31.035913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:31.066519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.067796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.068278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.069085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.070290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:31.070848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.073180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.092628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 235/475] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:31.100057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.115014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.131929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 241/476] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:31.172411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.254824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237ebb8-4ffd-4eef-9bb7-34e6a52a232c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.281775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.296859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.298300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.298796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.299230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.300182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.301855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.324189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61173e-b726-41e4-a395-8d44bf084d05 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.332390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 236/477] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:31 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:31.369048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.369755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.370038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.370311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.371221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.372721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.381347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:17:31.381347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 19:17:31.381347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [parameters: {'id': '4a72ab2654ce4438a46781c531c8a9e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 19:17:31.381347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:31.399549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return ref.to_dict() Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:31.400696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:17:31.401773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:17:31.402813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:31.403738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:31.404490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'id': '4a72ab2654ce4438a46781c531c8a9e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:31.405242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 19:17:31.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:31.406884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 242/478] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Jul 15 19:17:31 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:31.414807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.498211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.542737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400f19-ff63-41b4-a111-331dfe34be74 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.587886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.588871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.589246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.589630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.606214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-86c41398-c73c-4e5e-a0f4-03481303fa06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:31.614618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:31.615657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:17:31.616603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:31.618754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 237/479] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:31.624407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.735224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ef70-a1d9-416b-a810-451a97820a1f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.765800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.773661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.774371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.774655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.775027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.775809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:31.776118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.777587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1d413-cdae-4406-9725-5b62cbd00151 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.790903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 243/480] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:33.094334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd735d6-5bd1-4713-9f92-da67b1282d32 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.094859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd735d6-5bd1-4713-9f92-da67b1282d32 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.094859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd735d6-5bd1-4713-9f92-da67b1282d32 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.096393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 238/481] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:33.112444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09235-68bd-4efd-9e5a-6332203201c6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.112917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09235-68bd-4efd-9e5a-6332203201c6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.113019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09235-68bd-4efd-9e5a-6332203201c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.130229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e0d09235-68bd-4efd-9e5a-6332203201c6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:33.135814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e0d09235-68bd-4efd-9e5a-6332203201c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:33.225475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 244/482] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:33.255589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd735d6-5bd1-4713-9f92-da67b1282d32 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.284778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaedc43-ccab-44d1-9d79-2984b672cb55 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.285066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaedc43-ccab-44d1-9d79-2984b672cb55 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.285350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaedc43-ccab-44d1-9d79-2984b672cb55 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.287045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 245/483] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:33.292059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.292347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.292629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.321920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:33.323149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:33.412834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd735d6-5bd1-4713-9f92-da67b1282d32 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:33.456662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 246/484] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:33.470286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:33.479491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:33.480368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.480655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.480956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.489984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.505528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:33.524775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:33.525724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:33.526487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 239/485] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:33.540772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.552132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:33.600323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a379-c892-4920-8dbc-c4555b060922 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:33.635835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:33.636699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.637009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.637353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.647905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:33.655785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:33.656632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:33.657410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 247/486] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:33.663882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.746770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5bc07-4188-4fd3-992a-a7458f5a5533 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:33.786704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:33.787539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.787825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.788204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.788971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:33.789280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:33.790824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619624e-b820-4416-8895-c9dc3af1ade2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:33.790942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76311-42bf-4aed-8551-2e9992c2e7b0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:33.805076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:33.806318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 240/487] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:33.807956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b41cda-bebb-4b23-8f93-c455d11c2a07 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.808444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b41cda-bebb-4b23-8f93-c455d11c2a07 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.808951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b41cda-bebb-4b23-8f93-c455d11c2a07 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.811212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 241/488] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:33.812240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b41cda-bebb-4b23-8f93-c455d11c2a07 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.831188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:33.831873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.832150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.832420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.833180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:33.833484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:33.834892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90930e-922b-4b4f-a58d-ff9e46f1352c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:33.847546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 248/489] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:33.847546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.847546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.847546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.861887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:33.863128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:33.872572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:33.931926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b41cda-bebb-4b23-8f93-c455d11c2a07 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:33.934719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 249/490] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:33.935520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:33.970275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:33.971653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:33.972138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:33.972628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:33.984497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:33.986369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:34.005620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.006507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.007400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:34.007400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:34.007400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.007400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:34.009279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 242/491] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.010270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.043203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05445a-8f8f-4d71-a6a7-16918fc9f75c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.051243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.082033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.082870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.083152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.083424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.094167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.095667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:34.113151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.114628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 250/492] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.115662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.124115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.129742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec437c-42e3-498e-90bb-94e8fed8aca9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.169920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.170724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.171031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.171300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.182321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-2a0f6c8e-434d-43c8-a188-4acf4b42f4e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:34.190458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.191397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:34.192255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 243/493] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.192901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684856d7-6f55-4695-8b39-963571c11998 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.193776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684856d7-6f55-4695-8b39-963571c11998 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.193776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684856d7-6f55-4695-8b39-963571c11998 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.194925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 244/494] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:34.195434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684856d7-6f55-4695-8b39-963571c11998 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.224691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c9fd-7cf2-4314-ac5f-1cd55e97105c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.260741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.261420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.261706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.262029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.262767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:34.263106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.264525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.280860 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 251/495] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:34.280860 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.300643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.310771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684856d7-6f55-4695-8b39-963571c11998 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.353001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.353780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.354126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.354494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.355346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:34.355655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.357122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea038a-4c92-46d7-b6e0-60526e42f0db None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.369140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 245/496] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:34.370454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544e92-8464-43f3-ad5b-868e95a2515b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.370844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544e92-8464-43f3-ad5b-868e95a2515b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.371177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544e92-8464-43f3-ad5b-868e95a2515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.386569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-14544e92-8464-43f3-ad5b-868e95a2515b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:34.386715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423352e-79a2-4384-bce9-fa17fc144095 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.387871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-14544e92-8464-43f3-ad5b-868e95a2515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:34.401118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.422165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.422859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.423139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.423416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.424170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:34.424472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.425847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.433838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 252/497] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:34.434580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.456491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 246/498] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:34.458066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510897f5-9517-4d95-abc2-47b815857d04 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.458350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510897f5-9517-4d95-abc2-47b815857d04 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.458627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510897f5-9517-4d95-abc2-47b815857d04 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.459904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 247/499] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:34.460582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510897f5-9517-4d95-abc2-47b815857d04 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.534654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.554873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3316f6-6e06-4d40-b01e-e084f86ba603 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.568813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510897f5-9517-4d95-abc2-47b815857d04 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.587881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.588681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.588985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.589257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.596567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.598199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.602359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.603188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.603469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.603740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.610740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.612218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:34.613675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.614717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 253/500] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.615831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-8c9bbb0a-dcdf-4227-ba6b-f2bbabb53ff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:34.633143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.634188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:34.635310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 248/501] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.635975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.635975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.636194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.652388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:34.653697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:34.655676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.716948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fa92-819d-4017-8351-07336943b2b1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.721615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 249/502] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:34.722450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.759240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.760040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.760345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.760616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.769016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.771328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.772976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:34.790702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.791711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.792583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:34.792583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:34.792583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:34.792583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:34.792583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 254/503] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.793033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.830947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a62d-0847-44cf-bea7-d5c855d9d7b4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.863902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.864790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.865075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.865350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.872054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.876249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:34.884296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:34.885138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:34.885885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 250/504] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:34.886493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.896267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99e74-8207-4d2f-be56-aee6dc617f4d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.929275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.929950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.930232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.930512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.931387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:34.931699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.933165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.969828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 255/505] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:34.970567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.989049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0eeba-006b-436e-87d7-c8e3df7f93eb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.021730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.025382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.026043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.026318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.026588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.027449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:35.027855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.029298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.067143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 251/506] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:35.067927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.074615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85559f-5794-44de-af7d-95e60bd831f4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.111599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.112405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.112675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.112945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.122698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.123615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.124278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:35.141985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:35.142987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:35.143999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:35.143999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:35.143999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.143999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:35.144202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 256/507] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:35.144854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.168636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78611c-982b-4449-91c4-aed604e148e7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.201648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.202316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.202597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.202906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.203633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:35.203939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.205330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.216841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 252/508] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:35.217533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.244331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a90ec-6159-4b58-b76c-38194ba9c8fe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.245995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.280266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.280942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.281220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.281489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.282242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:35.282548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.283967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.291701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 257/509] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:35.292493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.318339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a90b1-0839-4ef5-a0e7-8778265796f1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.334357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.351684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.352341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.352650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.352898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.392565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d2f3-8a3a-4a11-9da9-2b913e4bfc86 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.419598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.421077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.426060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.426715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.427024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.427300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.459335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.497774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.499184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.520226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 253/510] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:35.521095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.538276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.596144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 258/511] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:35.596969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.621439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e508-56a5-4406-b699-76ec434f9006 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.654320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.655018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.655303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.655580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.656312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:35.656622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.658005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.660607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.669185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 254/512] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:35.670126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.704926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf492c5-a00f-497f-9d3d-bc933a5ce0ef None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.738766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.739624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.739906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.740180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.744149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.748036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.749465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:35.764440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:35.765361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:35.766204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 259/513] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:35.766751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.772303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb782-ee6e-4131-bb1b-154892f0960a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.807722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.808537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.808869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.809143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.819620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.821097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:35.838320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:35.839341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 255/514] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:35.840465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.866593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f514-93e4-4b99-8805-cf12010db433 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.889329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.900790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94128685-ec91-4259-b886-f18786c945dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.901599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128685-ec91-4259-b886-f18786c945dc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.901875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128685-ec91-4259-b886-f18786c945dc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.902151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128685-ec91-4259-b886-f18786c945dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.911936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94128685-ec91-4259-b886-f18786c945dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.913434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94128685-ec91-4259-b886-f18786c945dc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-94128685-ec91-4259-b886-f18786c945dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:35.930955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:35.931813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:35.932633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:35.932633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:35.932633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:35.932633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:35.932633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 260/515] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:35.932914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94128685-ec91-4259-b886-f18786c945dc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:35.944984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe171b9-e558-4d1a-ba6b-78dfe5edf10d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:35.972851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:35.981151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:35.981953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:35.982228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:35.982497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:35.992911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:35.994384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:36.011394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:36.012320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:36.013128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:36.013128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:36.013128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:36.013128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:36.013128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 256/516] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:36.013472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.033452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94128685-ec91-4259-b886-f18786c945dc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.067908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.068579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.068864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.069138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.069847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.071335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.093312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 261/517] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:35 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:36.094122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.128154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.138919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b688-4fa4-45fc-9eb1-a551a743ee9c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.175982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.176698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.176976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.177257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.178140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:36.178455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.179981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.200352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 257/518] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:36.206303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.227550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b77ec-e192-4bcf-8a2b-f416d796d20a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.250463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.274565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.274850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.274999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.275279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.276017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:36.276330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.277864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.293349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 262/519] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:36.294415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.320996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3c57-f3cf-4983-a83c-2f249a5b588d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.356552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.357223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.357501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.357766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.358483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:36.358813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.360184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.374951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 258/520] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:36.374951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.398462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.408291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f877c0-ca91-4f36-a98d-bf85b6e925e1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.445452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.446129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.446410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.446691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.447446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:36.447745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.449150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.461405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 263/521] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:36.462122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.481388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.486488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e191-ce51-4bf0-b9cf-dc32c8f3e8b2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.522303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.523305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.523757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.524247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.567643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10828c-c5bc-462c-b0a5-d9f86668bea5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.599467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.601529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.605948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.606766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.607084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.607368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.616335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.617809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:36.633238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:36.634138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 264/522] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:36.635438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.653367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.700845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.706652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 259/523] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:36.711738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.745900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b3583-f491-432f-9014-a1a94c139bc7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.782988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.783810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.784090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.784368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.791495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.795199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:36.810320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:36.811219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:36.812166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:36.816372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 265/524] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:36.817257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.823772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78c17-1321-47f4-929f-5c797119b13f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.859026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.860226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.860609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.860948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.868320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.869928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:36.888725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:36.889613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:36.890455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 260/525] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:36.891030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:36.898443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.930754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d395dd-59ef-4ec5-ac56-4994cb674cc2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:36.952760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:36.967867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:36.968544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.968948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.969225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.970070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:36.970376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:36.971864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:36.990616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 266/526] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:36.991454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.002743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e1132-43bf-4c06-b802-4c7464d9e5f7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.038247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.039315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.039734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.040154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.050696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.052188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:37.071287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:37.072131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 261/527] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:37.077933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.093131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7714e4-9bb7-4fcf-9b54-01255e142baf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.123312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.130354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.131426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.131426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.131589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.132392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.132714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.134160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.157123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 267/528] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.157123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.184887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3131-6853-473b-aafe-3cad49be9a31 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.204619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.223103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.224674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.225269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.225808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.226795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.227287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.229700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.254199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 262/529] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.255967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.264020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986326c4-44b7-4f9b-971c-f54d76f675af None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.301348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.302012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.302318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.302595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.364699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6b8b-7e48-4411-ace6-bf478e30deca None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.365550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.377640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.379391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.399094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.399764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.400046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.400321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.401042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.401353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.402745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.414119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 263/530] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.414969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.445194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.489014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 268/531] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:37.489861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.518074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0a7f-536a-49f2-bef5-55514955b38b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.550316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.551019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.551296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.551569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.552395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=94620d53b108470b9aebafcb5a8c38c0) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.552703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.554181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.559626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 264/532] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/role_assignments?user.id=94620d53b108470b9aebafcb5a8c38c0&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.560409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.618669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.631879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665772-1e08-4d13-9cf3-ce6efbc13961 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.682228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.682977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.683346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.683538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.684438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.684752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.686246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.696657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.699498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 269/533] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.700623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.709516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6420a-da0b-4e68-9d2c-b268672fc286 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.751431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.752596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.753081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.753570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.761865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.763635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:37.787740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:37.788650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:37.789543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:37.791664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 265/534] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:37.801765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.941035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a30c-15d8-4263-a620-252d82645d6f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.954193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcecfe-5126-4490-95d1-e72cb994189e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.994144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.994897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.995180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.995455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.996690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.997002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.998656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.012859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 266/535] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:38.021454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.026937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.027824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.028107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.028382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.049590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.051107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.054222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:38.081836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:38.082758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:38.083599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:38.083599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:38.083599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:38.083599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:38.091076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 270/536] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:38.097621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.114433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.197980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec21f2-83c4-4249-ac3f-707f93e57413 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.246803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a8f-c09f-4e89-b3fa-d05ea14d36da None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.248857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.249529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.249807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.250077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.250936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=74a111fbdcd64c0fa65e2ecbd0fdc4cb) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:38.251249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.252971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326453a-e7a0-491d-b167-59fc3fa14b0a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.262907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 267/537] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/role_assignments?user.id=74a111fbdcd64c0fa65e2ecbd0fdc4cb&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:38.264417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c85c5-01d7-4dfa-a9fa-36537655b7b5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.264709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c85c5-01d7-4dfa-a9fa-36537655b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.264984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c85c5-01d7-4dfa-a9fa-36537655b7b5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.275332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 268/538] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:38.281363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.281641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.282544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.300257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.301208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.301636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.302050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.302986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:38.303438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.305629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.319919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:38.321104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 271/539] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:38.321239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:38.328204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.410266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.454292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce885-246a-4cd4-aa9b-a1632844f160 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.495202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.496752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.497415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.497837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.505527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.507235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:38.524691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:38.525737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:38.526759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:38.529073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 272/540] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:38.534882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.548458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 269/541] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:38.601852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.624880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.651533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12156f8-ff16-4873-a6c4-9426cec9e191 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.680168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.695163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.697139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.697139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.697139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.698144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:38.698460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.699991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.744880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 273/542] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:38.751909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.780367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc115d1-6165-4782-839d-5c06b69240a4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.835791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.836656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.836942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.837220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.857887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:38.870068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:38.871023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:38.871847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:38.876073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 270/543] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:38.881596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:38.916536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9261-4b4d-4bae-b172-cf68fc8cb38a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:38.958464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:38.959653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:38.960178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:38.960647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:38.961719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=3386325f72224ab1b9719855b1fbbdc1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:38.962229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.964070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.964526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:38.971616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 274/544] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/role_assignments?user.id=3386325f72224ab1b9719855b1fbbdc1&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:39.017840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06096c1-cbf3-4de4-9431-fe23b2d6ef04 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:39.061677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:39.062391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.062675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.062979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.063749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:39.064064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:39.065491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:39.075134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 271/545] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:39.081131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:39.162246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:39.227740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a1f0-9050-449f-8534-5edb3fdd1a41 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:39.277233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:39.278082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.278360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.278644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.295716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:39.297219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:39.319441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:39.320350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:39.321775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:39.321775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:39.321775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:39.321775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:39.321775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 275/546] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:39.326456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:39.452634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641e7b-2a09-46aa-aaa2-1a1bf0267134 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:39.482024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:39.492715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:39.493725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.497584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.498100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.499077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:39.499584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:39.501205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:39.514579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 272/547] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:39.520240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:39.667258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66a98-b4f4-49e4-95a3-3a02672e7ad3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:39.668926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:39.718627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:39.719481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.719768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.720045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.733251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:39.734750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-eec35ff1-7091-4d5a-8175-a01a84f90a3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:39.752885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:39.753808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:39.755721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 276/548] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:39.760350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:39.819883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4804e3-4fe3-4308-9d67-b59eeea49384 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.820197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4804e3-4fe3-4308-9d67-b59eeea49384 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.820448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4804e3-4fe3-4308-9d67-b59eeea49384 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.821968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 277/549] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:39.829186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:39.829749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:39.830250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:39.849890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:39.851438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:39.951041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaff35-8172-4c03-b26f-75a72cac2919 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:39.981066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 278/550] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:40.006086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.009345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.011272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.011559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.011871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.012789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:40.013156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.014685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.050116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 273/551] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:17:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.057538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.157022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.159201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.163607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fa172-81aa-42be-bfe6-96d00cb45527 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.211847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.213647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.214177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.214946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.221722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5a48-346a-4609-a2ec-10b4d5f192f4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.231300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e004c288-9a29-42c6-9aad-d7efff7c877e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:40.242451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:40.243417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:40.244345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:40.252177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 279/552] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:40.252325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433760f1-8f96-48b6-9436-77f409a0dfe7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.252808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433760f1-8f96-48b6-9436-77f409a0dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.252808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433760f1-8f96-48b6-9436-77f409a0dfe7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.254217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 280/553] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:40.255559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433760f1-8f96-48b6-9436-77f409a0dfe7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.272670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.273339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.273621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.273895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.347428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.348924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ca35b-da8b-482d-b17a-394a95979013 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.395004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433760f1-8f96-48b6-9436-77f409a0dfe7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.411201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.445501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.446472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.447582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.448025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.449294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:40.449787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.451973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.467815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 274/554] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:17:40.467815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.467815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.467815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.468533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 281/555] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.469542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.487491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:40.488875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:40.494402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.561159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 275/556] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:40.562156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.604626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af660e5-a7e6-469e-bcd5-628279ae1391 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.642392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.643489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.643875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.644250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.654325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.658495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.660304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.679268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633227-6993-4ded-87af-f528f2c9e5b6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:40.680729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:40.681578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:40.682432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:40.682432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:40.682432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:40.682432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:40.689002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 282/557] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:40.689002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.717197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.718070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.718408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.718651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.730353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.732330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-2132e524-12dc-4e99-9428-6c1a7a6dacc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:40.750165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:40.751823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 276/558] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:40.752675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61ed8-0948-4e98-8575-5aed68ee478e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.753032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61ed8-0948-4e98-8575-5aed68ee478e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.753101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61ed8-0948-4e98-8575-5aed68ee478e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.758545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 277/559] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:40.758545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b61ed8-0948-4e98-8575-5aed68ee478e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.763002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.806057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adec88-ac8d-4d21-93a7-b50b42d15c7b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.847494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.848335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.848760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.848961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.860361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:40.868735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:40.869637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:40.870550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 283/560] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:40.871423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.876597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b61ed8-0948-4e98-8575-5aed68ee478e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.906163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.912836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.913765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.914264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.914758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.915609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:40.915920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.917305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0a0cd-3280-4f95-af73-f7a44e434006 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.933537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 278/561] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.933537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.933537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.933537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.947262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:40.948446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:40.984817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4914f2-c9d7-4dc9-892c-1e1606fd1a6e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.013861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.020615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 279/562] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:41.021462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.034475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.035495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.036008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.036459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.037524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.038013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.039797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.053658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 284/563] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.054774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.147046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce235-74bc-42d9-81c5-8c614273ce02 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.160527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9486-10f5-4ee5-8edb-3aff9fe9ffcb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.168423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.185124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.185917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.186184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.186461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.187254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.187566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.188955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.197584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 280/564] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.198385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.203571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.204397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.204682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.204958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.212756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.214153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:41.228403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:41.229269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:41.230108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 285/565] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:41.230683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.283009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.314726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c407a3-f0c4-4292-a76b-ddadf9b5ada8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.344587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cadde-6a8c-4bd4-a852-17fd9e6ce6a3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.356550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.357377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.357659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.357932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.368240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:41.376094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:41.376985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:41.377806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 281/566] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:41.378499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.385245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.386059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.386337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.386611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.394552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.396030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:41.409847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:41.411039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 286/567] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:41.411961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.421422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.481537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0021-0186-478e-886a-270cfba4f29b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.508804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eb6d-011b-4094-bba9-f452cf301f3e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.515578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.515935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.516742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.517019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.517338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.527887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.529367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.542426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.543074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.543354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.543622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.544403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.544712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.546117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-86306178-34cf-4a2f-8628-9d9f910ea21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:41.546505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:41.547433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:41.548435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:41.548435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:41.548435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:41.548435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:41.548435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 282/568] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:41.548948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2b21-9bc0-473b-acd6-912a1e6a12ec None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.549171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2b21-9bc0-473b-acd6-912a1e6a12ec None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.549464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2b21-9bc0-473b-acd6-912a1e6a12ec None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.555575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 283/569] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:41.555575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2b21-9bc0-473b-acd6-912a1e6a12ec None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.560760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 287/570] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.561595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.645333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.653892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2b21-9bc0-473b-acd6-912a1e6a12ec None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.658537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa783e-d276-453b-8e65-e97f1736f4bd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.686956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.687654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.687935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.688209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.688961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.689271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.690642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.692608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.693295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.693577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.693849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.694688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.695041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.696452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8966fd-e475-4e52-a468-fdf05bd10610 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.698438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 284/571] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.699291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.713898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 288/572] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.715823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.716287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.716561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.732645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:41.733842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:41.751412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.801496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 289/573] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:41.802344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.803565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca1d50-95bf-475b-909d-27205e25b1c0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.839046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.839721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.840062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.840336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.841057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.841364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.842747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.854359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 285/574] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.855174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.871909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.904609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f106d13-1c5e-4800-bbf6-4ccda163fd74 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.938907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.939554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.939831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.940105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:41.940942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=cbe289a5fd69404786a12a13e43bd697) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:41.941251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:41.942695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:41.948196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 290/575] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/role_assignments?user.id=cbe289a5fd69404786a12a13e43bd697&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:41.948965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:41.951671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0d7d6-05f9-4c3c-9005-38a3bdb40e22 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:41.984380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:41.991833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:41.992802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:41.993143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:41.993420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.005594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.007273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:42.026817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.027836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.028682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:42.028682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:42.028682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.028682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:42.028682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 286/576] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.029477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.084322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb8fe-74cb-4486-8fd3-f5af33744136 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.106401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.129863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.132234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.132234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.132490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.143169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7929b3-3dfa-49df-996f-93a4ad77700e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.147375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.148858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:42.172002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.172917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.173834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:42.173834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:42.173834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.173834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:42.175117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 291/577] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.176519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.178854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.179679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.179959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.180236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.190912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:42.198724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.199847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:42.200731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 287/578] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.203590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.259279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.298808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca57a7-cabc-4e40-965f-1d1d3816e80e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.308342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168a06-927b-4310-a125-2b5eeac5c5d5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.337693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.338257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.338367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.338628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.338928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.347124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.347778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.347893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.348066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.348336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.349061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:42.349241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.349393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.350729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.367423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 288/579] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:42.367423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:42.368082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.368965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 292/580] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.369890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.469510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bad89-5162-4a70-ad88-d3d114924218 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.471177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969b99-8758-42cb-b642-394499c71286 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.501097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.506900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.507585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.507866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.508049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.508183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.508691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.508853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:42.509004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.509151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.509252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.509966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:42.510271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.510515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.511673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.520639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 293/581] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:42.521328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.526902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 289/582] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:42.528128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.584293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.645607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532a98-eb57-4f12-b307-28558dc7a65e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.663273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070e14-1fb2-4a4d-a707-b03c7aa6081d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.681689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.682155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.682610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.682884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.683865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:42.684245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.685752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.708453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 290/583] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:42.709326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.717818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.718899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.719359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.719805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.728389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.730251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:42.745785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.746708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:42.747630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:42.749827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 294/584] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.750759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.821498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.837159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19dbd1-91bc-4c5e-ad34-44279f60c676 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.850696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:42.882467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.883539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.883878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.884221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.886538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093b1c-cf60-4fcc-9876-63fddae166e1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:42.896024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.898017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:42.921153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.922238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.923336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:42.923336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:42.923336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:42.923336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:42.928368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 291/585] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.928368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.931673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:42.932569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.932927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.933313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.943640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:42.945961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:42.966707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:42.967788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:42.968824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:42.969637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 295/586] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:42.970342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.062467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c57ee-2b49-471b-b7a9-1b8518e44d8b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.080726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e35d9-d449-4d3d-b10e-9c9ea2d855c9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.095848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.100991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.101810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.102094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.102365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.113009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.114473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.118852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.119537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.119824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.120100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.120951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.121314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.122737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:43.132323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:43.133341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:43.134218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:43.134218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:43.134218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:43.134218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:43.134218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 292/587] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:43.134492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.146670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 296/588] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.147549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.151898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.240329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d69ba-d759-4d15-9f71-7f90114d6d25 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.253324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d97f-3dcc-4047-b6ed-2f9dfe437d45 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.279206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.279889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.280171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.280444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.281174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.281484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.282896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.289244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.290369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.290651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.290959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.292193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.292501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.293975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.299168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 293/589] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.299168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.310818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 297/590] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.311440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.343141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.383226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.417447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212971-0e5a-4227-b58e-7fe6f266290d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.418894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f816-10bf-4bb1-927f-4cf2bcc09908 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.452036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.452708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.452993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.453271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.453535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.453997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.454308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.454406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.454618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.454932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.456102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.466094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.467587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.474423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 294/591] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.474423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:43.491160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:43.492388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 298/592] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:43.493257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.577670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.585945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24630d2-8765-40ce-8ffb-03815b459da0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.598694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a975-b4e1-4ffe-a91c-3cdc44650b4b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.615638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.621849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.622669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.622979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.623261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.630497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.631989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.635672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.636607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.636922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.637199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/94620d53b108470b9aebafcb5a8c38c0/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:43.646582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:43.647514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:43.648430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 295/593] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:43.648983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.657629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=94620d53b108470b9aebafcb5a8c38c0, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.658989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.672382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 299/594] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:43 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/94620d53b108470b9aebafcb5a8c38c0/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:43.673127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.776250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6e94-084a-4fe5-9821-63099147bfbb None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.809058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fdf4d-9b0d-45fe-99b4-981d587e9f66 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.821113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.822432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.822733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.823026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.833317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.835704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.845715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.852125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.853097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.853713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.854138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.855062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.855566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:43.856833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:43.857862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:43.859126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:43.860335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.863165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 296/595] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:43.864661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.877377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 300/596] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.878471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.923795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.984844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582acc-8dfa-4f5e-bd95-5aaef055d1df None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.990839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600b43-613d-42c8-a0d4-fb93cdd7dd79 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.024713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.024928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.025398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.025493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.025681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.025773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.025957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.026046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.026795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:44.026901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:44.027109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.027229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.028620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ce8d6-0e3f-4e42-a339-be5a4c17d530 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.028720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.046406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 301/597] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:44.046406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.050945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 297/598] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:44.052671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080834-1a00-400c-a16d-5327d4d48228 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.052966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080834-1a00-400c-a16d-5327d4d48228 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.053245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080834-1a00-400c-a16d-5327d4d48228 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.055148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 298/599] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:44.058832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080834-1a00-400c-a16d-5327d4d48228 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.103635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.155529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9cce-17df-4a8a-9fa6-f9f587229de3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.164498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080834-1a00-400c-a16d-5327d4d48228 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.173786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.194806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.195888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.196349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.196798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.198989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.199986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.200268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.200538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.205812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.207589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.215439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=1876435c9cdf4e11a6d193017d53ed49, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.216886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-20d7b464-8c1c-4a52-a5d9-b8906d451256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:44.223190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:44.224411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:44.225444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:44.232180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 299/600] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:44 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:44.232180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.232527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 302/601] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:44.233966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.234257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.234537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.260211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:44.261451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:44.355974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 303/602] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:44.357107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.384495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec96a-7db6-46e0-a84c-f2c968514a53 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.412979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.430565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.432724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.432724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.432724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.450424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.452291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:44.472020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:44.472923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:44.473841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:44.473841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:44.473841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:44.473841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:44.476136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 300/603] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:44.477278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.484355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a6cff-4210-4417-b14e-a22183bef161 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.495074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.527361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.528047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.528359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.528636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.529436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:44.529748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.531930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.546996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 304/604] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:44.550813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.602502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c662c-302c-43fc-a7df-c43ad0f0f7d7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.639055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.640388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.640979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.641451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.652711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82acd57-6968-41e7-9ec8-ac8b63a01287 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.653154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:44.654274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:44.663164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:44.664231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:44.665042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:44.672662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 301/605] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:44.674510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.688267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.688945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.689232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.689514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.690246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:44.690554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.691990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.703812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 305/606] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:44.704678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.788221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327546d-fab9-4ad9-8a13-a7b8cb6a9fc3 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.807271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcd4b-cc80-4703-82ad-3c425f1c6f29 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:44.811202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:44.831424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.832742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.833268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.833810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/74a111fbdcd64c0fa65e2ecbd0fdc4cb/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.842002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:44.842700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:44.843009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:44.843283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:44.844034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:44.844341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.845733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.853109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=74a111fbdcd64c0fa65e2ecbd0fdc4cb, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:44.854861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:44.858847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 306/607] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:44.859684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.874763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 302/608] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:44 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/74a111fbdcd64c0fa65e2ecbd0fdc4cb/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:44.884318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:44.887651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:45.003946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbed3f-bf8a-44dc-8c41-45be6867baa3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.016448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db1779-56f4-4f4b-952b-95123ed56ed4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.043263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:45.063257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.066962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.067250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.067523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.078931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.079770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.080048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.080682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.091148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.092650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.093915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.095412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:45.118900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:45.119847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:45.120690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:45.121851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 307/609] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:45.130300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:45.132389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:45.134654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:45.134654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:45.134654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:45.134654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:45.134654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 303/610] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:45.135330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.139003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.295276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:45.301791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2088-20fd-42b1-9bcc-6fca62e445ba None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.316804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2741-e16d-4bbd-a102-5bea44729810 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.373721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.374405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.374685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.374981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.375711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:45.376015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.377402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.378387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.379113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.379392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.379658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.380451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:45.380755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.382185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.403651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 304/611] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:45.406207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 308/612] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:45.409300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.412453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.479805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:45.537182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4939db-7bf0-47a3-815c-f98bc855917b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.595467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.596275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.596557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.596832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/3386325f72224ab1b9719855b1fbbdc1/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.628760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=3386325f72224ab1b9719855b1fbbdc1, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.630237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.632665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:45.634435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66baa-f16c-419d-987b-9eb77d6a6acd None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.660689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 309/613] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:45 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/3386325f72224ab1b9719855b1fbbdc1/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:45.687213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.688041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.688322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.688597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.702230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.703735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d0047816-5612-4465-a486-a4fbac2b746f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:45.729973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:45.731214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:45.732120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 305/614] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:45.737299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.870474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd356-4172-40b6-8a5a-2dc1e7e0dbf5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:45.871167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-1c9c-4ebc-b8cc-2f6a0369737c None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.871464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-1c9c-4ebc-b8cc-2f6a0369737c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.871744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-1c9c-4ebc-b8cc-2f6a0369737c None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.877629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 306/615] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:45.882520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.882823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.883102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.911780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:45.912829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.913258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.913682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.914698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:45.915203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:45.916794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:45.928305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:45.929505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:45.936475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 310/616] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:45.942118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.000694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.014245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 307/617] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:46.042807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.076431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f4882-e2c1-41ef-9844-1a07c54f40d5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.080175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.138268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.139112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.139392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.139664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.158221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.159730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:46.191631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:46.192562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:46.193486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:46.193486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:46.193486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:46.193486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:46.202417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 311/618] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:46.208310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.225081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f355-36c6-40d9-8a6b-02da3b6aa8b0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.290149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.291058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.291336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.291652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.313609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:46.326462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:46.328705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:46.331071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:46.335788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 308/619] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:46.337423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.409480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342953-4fbb-45c4-83d2-a5f8d3df6c07 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.412343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.458691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.459393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.459670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.459937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.460665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:46.460967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.462336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c8cfb-c867-4dcf-b9cc-e0728b9a7c39 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.485399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 312/620] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:46.490534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.491431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6675-a00f-49f7-a999-ae31e2d21ef5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.491917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6675-a00f-49f7-a999-ae31e2d21ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.492362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6675-a00f-49f7-a999-ae31e2d21ef5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.494008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 313/621] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:46.496774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6675-a00f-49f7-a999-ae31e2d21ef5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.503927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f3f2d-0bd2-4fe7-86ac-775147661ed5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.539789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.540626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.540999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.541366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.542204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:46.542606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.544312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a1df-d6e1-47e0-b79e-cd04fdd91206 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.553406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 309/622] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:46.554860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.555438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.555694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.572662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:46.574168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:46.610246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6675-a00f-49f7-a999-ae31e2d21ef5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.645395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 310/623] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:46.646382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.648024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.649105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.649656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.650153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.657847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.659807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:46.675362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:46.676308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:46.677187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:46.679790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 314/624] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:46.685851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.714469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.742653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.774822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605d74-9529-4945-8681-ac2d3d67b49e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.811010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267036-f878-495f-a0e2-a1f038bb74f4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.815541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.816424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.816766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.817098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.829680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.832050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.848799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.849919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.850384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.850873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:46.853603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:46.854639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:46.855798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:46.855798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:46.855798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:46.855798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:46.856801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 311/625] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:46.857644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.866587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:46.875212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:46.876215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:46.877050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:46.879698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 315/626] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:46.880751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.973427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa67d-958d-4eaa-b4e2-892f4be06834 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.981654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.002836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.003785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd1397-fe5b-4294-9b18-7b87c20cb226 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.014411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.015552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.016060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.016532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.017588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:47.018112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.019906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.038216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 312/627] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:47.039648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.042623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.043366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.043647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.043911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.045594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:47.045908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.047322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.064466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 316/628] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:47.065327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.161428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5456-bedc-4f03-b5c7-ce01d2768bc7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.192427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e2a6-1987-494b-bd1f-2f2e45e572d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.210318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.211660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.212144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.212583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.213508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:47.213983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.216373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.228483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 313/629] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:47.229489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.229755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.230585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.231053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.231415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/cbe289a5fd69404786a12a13e43bd697/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.248980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=cbe289a5fd69404786a12a13e43bd697, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.250443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.252812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.271096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 317/630] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:47 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/cbe289a5fd69404786a12a13e43bd697/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:47.271096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.290155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.351505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34103-bf16-4221-b4ef-aa7e8e01faa5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.381274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa54a23-a280-49bf-b7c5-8e3030d16688 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.390991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.392168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.392641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.393088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.402832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.404887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.420723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.421527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.421813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.422115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0b346498-3291-4132-83ed-9bcc471b83a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:47.424187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:47.425114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:47.426033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 314/631] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:47.427108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d87-4f76-485b-a967-f378f736cfa4 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.428986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d87-4f76-485b-a967-f378f736cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.428986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d87-4f76-485b-a967-f378f736cfa4 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.429257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 315/632] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:47.431591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4d87-4f76-485b-a967-f378f736cfa4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.434257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.435799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4869ff2d-ad45-4134-aa64-540bfa83635e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:47.454370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:47.455701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:47.456593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:47.456593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:47.456593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:47.456593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:47.456593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 318/633] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:47.457218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.457506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.457853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.478610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:47.480024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:47.526482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.550620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4d87-4f76-485b-a967-f378f736cfa4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.553744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 319/634] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:47.554798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.568918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.610543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.611265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.611547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.611822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.612696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:47.613111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.614656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.634052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 316/635] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:47.635126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.658574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73bc56-4bc2-4464-8102-3440ab64e191 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.693995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.694680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.694992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.695276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.696002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:47.696311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.697891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.714538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 320/636] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:47.714538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.754918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5312a-932f-4325-bd29-d80d750b3c99 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.756774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.813659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.814490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.814772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.815207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.829906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:47.834813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dac1f3-5ab8-49ea-bbb9-c0d5d3dee61b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:47.840783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:47.841722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:47.842540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 317/637] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:47.844152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:47.875027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.876139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.876423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:47.876695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:47.882489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:47.960413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:47.963334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198fd2-9d96-4a7b-976b-00b8b8cc9bf0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:47.963668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd912e7-eca7-452d-b080-7f4ccd1a181a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:47.998772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:47.999607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:47.999892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.000146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.000671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.008197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.009571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:48.024688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:48.025652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:48.026576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 318/638] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:48.028080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 321/639] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eb86e-974e-4639-9bc7-b03c78be9d56 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eb86e-974e-4639-9bc7-b03c78be9d56 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eb86e-974e-4639-9bc7-b03c78be9d56 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 322/640] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:48.080673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1eb86e-974e-4639-9bc7-b03c78be9d56 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.128071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.146516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bd09-ddd3-4d0a-b3f6-43f7be57f7be None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.184844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.185643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.185892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.186164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.187065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:48.187361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.188732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.191101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1eb86e-974e-4639-9bc7-b03c78be9d56 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.202419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 319/641] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:48.202419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.236308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.236985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.237262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.237921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.238775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:48.239100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.241192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ce3db-fb86-41ad-92c4-9e279ef4bd4a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.243731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.260400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 323/642] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:48.262039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.262550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.263055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.279925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:48.281225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:48.304217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78752-c999-4c8e-883a-cd567edbccd4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.344932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.345730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.346005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.346272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.352054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 324/643] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:48.357341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.359596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.363724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.370100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:48.380542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:48.381701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:48.382835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:48.382835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:48.382835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:48.382835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:48.386954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 320/644] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:48.387909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.486909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea69ad-90c3-43c5-b095-d63176853434 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.501369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57693a06-25c8-4f63-b256-26f079ee617a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.512669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.524630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.525587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.525868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.526142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.536798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.538331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.542871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.543545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.543831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.544108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:48.556318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:48.557211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:48.558256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:48.558256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:48.558256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:48.558256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:48.558256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 325/645] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:48.558619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.615669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.618566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.620587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.665604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04ca48-e0ab-490a-a0b6-d7068f97725b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.699321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.700163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.700447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.700720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.712537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:48.720393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:48.721307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:48.722115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 326/646] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:48.723297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.733977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 321/647] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:48.735081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.765836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.863557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.867618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0882950-f534-4c9f-bdaf-4c6271296767 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.873809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3876-7e09-42b0-8212-d2122d7b07dd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.907293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.908055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.908406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.908746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.909576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:48.909909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.911392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.912293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.913035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.913381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.913719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.914519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:48.914922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.916355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.928650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 322/648] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:48.928650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.937062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 327/649] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:48.937062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.036984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42515e-740c-42f6-8622-51b73a6a60d5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.037753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.044541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1035f7a-7bee-4b07-a443-9105c2df281c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.071920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.072597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.072871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.073136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.073911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:49.074216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.075650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.080016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.081434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.081850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.082218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.088811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 323/650] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:49.088811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.098014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.099629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.111713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:49.117161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:49.118211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:49.119259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:49.119259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:49.119259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:49.119259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:49.119259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 328/651] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:49.123732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.201291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675cbe-6dcd-4530-b3d8-90a248913d0f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.235348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.235574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69b88-4a0b-4d9f-9282-320a31509b01 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.236155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.236436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.236702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.244416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.245929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:49.260304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:49.261222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 324/652] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:49.262767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.276142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.276961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.277312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.277590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.284626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.286086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:49.300994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:49.301931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 329/653] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:49.307731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.317265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.352379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.371683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a92a9-9a4f-4f97-95d4-f76ffb8c9ea3 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.404668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.405475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.405756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.406031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.413182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1e4f-ca93-4b4e-ab64-99946b62403e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.416381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.417887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:49.434368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:49.435330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:49.436217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:49.436217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:49.436217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:49.436217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:49.436217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 325/654] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:49.436497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.450006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.450683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.450989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.451261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.451986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:49.452288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.453700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.465807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 330/655] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:49.466588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.537025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.541794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9bc53-f109-4429-8510-5bf9a13581c9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.570262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245344e-cf35-488f-9025-5234d3fd2546 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.575616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.576297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.576578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.576844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.577690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:49.577999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.579477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2a79-17a3-4ade-a6a2-d1432099f2e2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.581449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.597671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 326/656] 10.222.0.57 () {56 vars in 1137 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:49.598937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c183-8f4a-47c9-837f-dcf35402a822 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.599226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c183-8f4a-47c9-837f-dcf35402a822 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.599502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c183-8f4a-47c9-837f-dcf35402a822 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.600710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 327/657] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:49.601397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c183-8f4a-47c9-837f-dcf35402a822 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.609155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.609797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.610096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.610368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.611195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:49.611504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.612965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.625209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 331/658] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:49.625820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.706589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c183-8f4a-47c9-837f-dcf35402a822 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.733366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca8b9b-5da1-491a-96ed-3b56bf8dda11 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.742059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.742738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.743050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.743327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.744058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:49.744367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.745811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.757178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 328/659] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:49.757976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.762264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.771049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.771851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.772128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.772387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.779413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.780869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cd63916d-ef83-4e7c-ad50-86fb17ace660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:49.794478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:49.795459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:49.796400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 332/660] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:49.796892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.797476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.797476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.814613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:49.815145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:49.815877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:49.862490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138c11-4bd9-4efc-8797-f5051034c992 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:49.883133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 333/661] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:49.883969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:49.909602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:49.910256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:49.910544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:49.910850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:49.977409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:49.978901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:49.984095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270a43-b2ac-4095-9794-c58acb4d153a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.001183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.019878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.020548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.020833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.021112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.021951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=94620d53b108470b9aebafcb5a8c38c0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.022264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.023754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.029155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.030029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 334/662] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/role_assignments?user.id=94620d53b108470b9aebafcb5a8c38c0&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.031410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.090579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 329/663] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:50.091679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.149235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181809f-5bc5-4931-b112-fa49e2fdcb00 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.189462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.190278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.191045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.191321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.201324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.202753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.204657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d5a7-1073-4007-a042-420f04312db4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:50.221074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:50.222126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 335/664] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:50.223172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.245338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.246014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.246292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.246567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.247403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.247713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.249149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.262693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 330/665] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.265077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.280663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.282408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.339688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969303ab-e6b4-4114-b474-8082b4676af3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.375885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.376559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8ad9-9699-45bb-9fcd-e94bac01499d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.376692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.376967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.377239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.387574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:50.395412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:50.396652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 336/666] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:50.397455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.422535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.423691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.424575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.425040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.436439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.438099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:50.456564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:50.457659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:50.458657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:50.458657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:50.458657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:50.458657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:50.460231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 331/667] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:50.461160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.511379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe212a72-87df-49fd-b1b2-84b8d97c4d25 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.513210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.529052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.550159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.550872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.551160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.551422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.552446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.552552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.553984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.571284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c782-9168-401f-b941-3aef185e2165 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.573651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 337/668] 10.222.0.57 () {56 vars in 1139 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.574559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.610316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.611014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.611299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.611574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.612399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.612711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.614176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.627199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 332/669] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.629152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.682544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74aed-bf5c-4784-90ff-55cb6f9e6fc0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.723573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.724675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.725163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.725659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.726628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.727163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.728781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.738923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 338/670] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.740634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.768130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.780663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f995cca-7964-47a5-8f21-d2f689eb5a7a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.814930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:50.826033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.827311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.827311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.827507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.828267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:50.828577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.829946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:50.842904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 333/671] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:50.843656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:50.867809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e9daa-e150-4240-9f9a-f234898ab128 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.915010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.916077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.916422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.916704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.956532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ec35-5b4b-4ae1-addd-fca5ff6fc54a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:50.991171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:50.991762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:50.992572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.992900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.993170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.994102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.003859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.005498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.019832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:51.023179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:51.027605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 334/672] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:51.028589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.071967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.104515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 339/673] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:51.105566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.131386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022fae-ca95-4b36-98fd-53172c17b945 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.166079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.167197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.167591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.168021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.175112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.176666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:51.190813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:51.192396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 335/674] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:51.194416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.218956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f72-b5e2-4586-9118-a18a235520e3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.247859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.260475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.261152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.261537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.261812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.262653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.262996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.264475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.276730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 340/675] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.277726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.332459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.336558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9c38-4240-40ee-8fba-5891c677cab5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.384159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.384994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.385271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.385540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.393528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddfdc-bde2-40a0-a123-47776c18340f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.398824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.400290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:51.417677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:51.418604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:51.419524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:51.419524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:51.419524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:51.419524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:51.423509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 336/676] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:51.424373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.438383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.439647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.440123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.440816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.442278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.443073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.445324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.463939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 341/677] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.465131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.521820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.546922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d9e9a-d341-4f0d-a943-a4e669a7bff9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.583176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.583992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.584271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.584543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.592447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.593899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.600611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0d89a-e0c7-44b2-8dbd-9c8cdd9c0958 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:51.608877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:51.609810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 337/678] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:51.611367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.627114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.648822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.650640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.651128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.651588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.652507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.652993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.655064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.670848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 342/679] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.672030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.723616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bcd85-7750-4bbf-9f84-d1c06ebde787 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.758833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.759858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.760146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.760488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.761512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=74a111fbdcd64c0fa65e2ecbd0fdc4cb) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.761889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.763428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.775353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 338/680] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/role_assignments?user.id=74a111fbdcd64c0fa65e2ecbd0fdc4cb&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.779510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.800058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537cdeb-a937-4a1c-8f28-64aca3e419b9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.802221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.845001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.846112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.846597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.847126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.848783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.849443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.851163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.874070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 343/681] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.887709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.977045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.990656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0716-913c-40a5-9425-91b7f31aa233 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.027018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.027779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.028055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.028327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.037398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.038899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:52.053818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:52.054702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:52.055599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 339/682] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:52.061037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.062184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4341-a380-4317-995c-9f7d617d7cd5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.106205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.106897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.107235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.107513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.163202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.190182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.191949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7efd-d0b5-468d-9c68-a65fc7dc40a9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.215662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b7803-8098-4fd4-a319-e2c9c7c3a64c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.252070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.252743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.253017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.253287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.254074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:52.254378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.255840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf25f-d94f-42f3-9060-611868d89aec None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.258456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.269413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 340/683] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:52.270845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878e8e-34b5-4d80-9415-051cddbd51bb None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.271129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878e8e-34b5-4d80-9415-051cddbd51bb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.271401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878e8e-34b5-4d80-9415-051cddbd51bb None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.276734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 341/684] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:52.277643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878e8e-34b5-4d80-9415-051cddbd51bb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.311280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 344/685] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:52.312674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.312962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.313239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.331573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:52.332787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:52.387759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878e8e-34b5-4d80-9415-051cddbd51bb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.399145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.401329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 345/686] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:52.403724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.447068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.447807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.448137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.448413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.449319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=3386325f72224ab1b9719855b1fbbdc1) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:52.449675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.451248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.461688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 342/687] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/role_assignments?user.id=3386325f72224ab1b9719855b1fbbdc1&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:52.462595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.512861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa892f-61e1-47b7-92ef-a2f48fb68ccb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.550951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.551703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.551981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.552740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.568699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.570211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:52.593865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:52.594887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:52.595757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:52.595757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:52.595757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:52.595757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:52.595757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 346/688] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:52.603946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.607188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.655548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.675956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebb710-4998-49b8-a89c-7f24f7c09306 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.718406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.719697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.720274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.720618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.725161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7489-0c6d-40aa-b202-4b3b833873e8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.732678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.734230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:52.752736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:52.753647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:52.754497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:52.754497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:52.754497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:52.754497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:52.756718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 343/689] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:52.763882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.765830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.766814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.767173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.767524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.768339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:52.768755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.770236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.790938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 347/690] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:52.796917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.876867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906231-0607-4ff3-a01b-a9ed9ca72280 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.891113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.906149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839ffa-0abf-497f-981c-ecfdccf41946 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.909229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:52.913682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.914438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.914726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.915324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.915897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:52.916300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.917841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.931073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 344/691] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:52.938202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.955903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.956797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.957084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.957349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.986511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.988027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-539ae903-7786-4cdf-840c-96a9a9c79e74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:53.003009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:53.003925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:53.004886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 348/692] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:53.010910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227598a-8c39-4415-883a-27745ccbe4fd None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.010910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227598a-8c39-4415-883a-27745ccbe4fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.010910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227598a-8c39-4415-883a-27745ccbe4fd None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.011859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 349/693] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:53.012633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227598a-8c39-4415-883a-27745ccbe4fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:53.064200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfc54-5c45-461a-9d8c-5a2e82685a78 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.111935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.112867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.113564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.113851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.114854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:53.116522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8ac56-9a58-4076-a179-23c142ef1ab2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.117070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227598a-8c39-4415-883a-27745ccbe4fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.143853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 345/694] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:52 2022] POST /identity/v3/users => generated 254 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:53.145245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.145543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.145875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.166968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:53.168488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:53.183243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.183993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.184277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.184533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.185360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:53.185644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:53.192090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.198809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:53.212809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 350/695] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:53.218741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:53.274058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:53.293657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 346/696] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:53.339985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:53.402936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb627-1464-4c6a-b0a5-cbd81e35bd0e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.443085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.443796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.444075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.444346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.445172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=cbe289a5fd69404786a12a13e43bd697) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:53.445482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:53.446968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.456820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 351/697] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/role_assignments?user.id=cbe289a5fd69404786a12a13e43bd697&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:53.479106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200955b-5cdc-4836-9e9c-f26cf4760e0e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.518879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.519776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.520108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.520386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.533278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:53.541454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:53.542460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:53.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 347/698] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:53.549231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:53.646968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:53.663207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7a98-21d9-4140-9f39-b39b0ebdf41e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.699064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.699758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.700044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.700311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.701076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:53.701388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:53.702772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.712272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 352/699] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:53.717949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:53.743211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:53.825648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea0a2-8ea7-4d72-a6d7-09716de06029 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:53.861007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:53.861827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:53.862107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:53.862379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:53.873837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:53.875351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:53.893355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:53.894372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:53.895334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:53.895334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:53.895334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:53.895334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:53.895334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 348/700] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:53.902474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.010082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087d60-3c63-42db-a151-80cf88026a84 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.045013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.045700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.045983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.046256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.047014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:54.047326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.048708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9376-4490-42e3-9376-ccd5789a790f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.061302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 353/701] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.066892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.139215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.170639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dc0eb-1dcd-453c-8fc1-cdca442d0360 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.205820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.206638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.206953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.207224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.212580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504edee-a8cf-4680-bb0d-8e8424f7886f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.212871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504edee-a8cf-4680-bb0d-8e8424f7886f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.213147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504edee-a8cf-4680-bb0d-8e8424f7886f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.214720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 354/702] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:54.220373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.220586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.220586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.220586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.221067 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.238072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:54.238454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:54.239387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:54.240360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 349/703] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:54.242692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:54.245330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.251180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.325486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 355/704] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:17:54.347222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.442774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe12016-1a6f-463d-86b7-253ae9523586 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.470369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a814b-9a7e-432b-be40-75138d537b9a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.492432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.503780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.504481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.504783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.505055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.505870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:54.506179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.507642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.509717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.510829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.511346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.511831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.512690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.514283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:54.528942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:54.529931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:17:54.530735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:54.533638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 356/705] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:54.540656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 350/706] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:54.546515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.546648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.553392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.684120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f8e4-ee48-4438-9964-c05f21116db8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.703349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931f771-331c-4a86-a065-1956a95ba3d6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.739040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.739975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.740431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.740848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.741713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:54.742167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.743725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.749086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 357/707] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.755899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.784824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.785753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.786182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.786639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.883992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.903142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.927215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.928702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb02c6-ce3f-4d71-85b4-6e0d01eb5de3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.940620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa017-f3ee-479b-ad66-e4431b51638f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.008207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.008898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.009182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.009456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.010187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:55.010739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.011973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.018676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 358/708] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:55.103350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 351/709] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:55.112019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.135570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7602b-66af-4085-9645-78aad96a8c85 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.135917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7602b-66af-4085-9645-78aad96a8c85 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.136390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7602b-66af-4085-9645-78aad96a8c85 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.139066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 352/710] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:55.148854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.149212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.149429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.188257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:55.189471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:55.287830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcbaff-1fce-473a-b4c9-24f511133988 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.301000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 353/711] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:55.327074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.329293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:55.347482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.348309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.348589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.348861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.352038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:55.367866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.369337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:55.394227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:55.395200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:55.396113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:55.396113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:55.396113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:55.396113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:55.404459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 359/712] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:55.410060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.437263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e560e5-c031-49f4-80f6-bb62c12e9dc8 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.482084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.483024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.483321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.483601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] PATH_INFO: `/v3/services/network` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.484268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.485673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:55.505909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:55.507211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:55.508204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 354/713] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:55.513290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.577401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdd10-bf6c-47e8-a25b-3a4d24ec4c07 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.625231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.625920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.626224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.626478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.627383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:55.627698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.629381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.647340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 360/714] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:55.649198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.699339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:55.710751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:55.751432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263faa03-0523-4ac4-b72d-2bced1409b70 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.760478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ec46c-0308-4b1e-ba39-634a9035f38d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.802803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.802803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.802803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.802803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.806741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.808390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:55.822923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:55.823873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:55.825128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 361/715] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:55.830912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.832636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.833340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.833621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.834004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.834842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:55.835159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.836566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.852243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 355/716] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:55.862295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:55.944077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716262b-6550-46d0-bc31-1b573bb22923 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:55.945902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:55.983862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:55.984543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:55.984939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:55.985220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:55.986021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:55.986333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:55.987817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c898-5d92-42dd-b706-86898a1d5fc8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.999895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1742c78-3808-401b-a705-12b25b0624c9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.008068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 362/717] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:56.008068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f92174-dd3a-4cc5-ab14-f0b58ee8c6ec None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.008068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f92174-dd3a-4cc5-ab14-f0b58ee8c6ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.008068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f92174-dd3a-4cc5-ab14-f0b58ee8c6ec None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.008068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 363/718] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:56.009433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f92174-dd3a-4cc5-ab14-f0b58ee8c6ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.043786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.044850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.045342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.045816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.046850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] RBAC: Adding query filter params (type=network) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:56.047384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:56.049072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3b98-69aa-4168-9d82-550ac99dc262 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:56.062967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 356/719] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:56.064853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f8361-b0fd-44c6-8597-2fa268195051 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.065348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f8361-b0fd-44c6-8597-2fa268195051 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.065868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f8361-b0fd-44c6-8597-2fa268195051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.093995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-929f8361-b0fd-44c6-8597-2fa268195051 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:56.095604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-929f8361-b0fd-44c6-8597-2fa268195051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:56.104101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:56.124893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f92174-dd3a-4cc5-ab14-f0b58ee8c6ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.173745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.174431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.174706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.175024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.176493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:56.177088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:56.178890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25892-ab4d-4bca-b9ce-962762ea7f76 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:56.188479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 364/720] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:56.189949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb169a9-0ed9-47aa-8eef-0b2360860b98 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.190234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb169a9-0ed9-47aa-8eef-0b2360860b98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.190507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb169a9-0ed9-47aa-8eef-0b2360860b98 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.191416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 357/721] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:56.196048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 365/722] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:56.201806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.202311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.202755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.215779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb169a9-0ed9-47aa-8eef-0b2360860b98 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.240973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:56.242251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:56.274230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:56.354030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 358/723] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:56.387157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb169a9-0ed9-47aa-8eef-0b2360860b98 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.400214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.426725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.427577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.427857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.428128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.444136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:56.452215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:56.453148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:56.454158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 366/724] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:56.459715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.495533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:56.531342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5db8-c5d2-4069-9a10-5e7a019b105d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.571042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.571866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.572149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.572424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.584070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:56.592179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:56.593137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:56.594238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 359/725] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:56.601086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.663571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:56.677651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afdf2-205f-4f86-b1aa-6ee203c23b03 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.729429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.730255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.730537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.730826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.734503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:56.739874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:56.741373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:56.756849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 367/726] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:56.761018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.788676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847e06-4494-4f57-b74f-bcb8c21c86ea None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:56.823543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:56.833620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:56.834369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:56.834647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:56.834941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:56.835702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:56.836011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:56.837398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:56.860032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 360/727] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:56.861578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:56.992594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a398d14-2ab5-465c-a0c8-e810c620328f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.042043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82bda6-79e0-4e8e-9258-b452d7a071e9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.058985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.060163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.060650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.061143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.085381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.087263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.096713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:57.108147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:57.109032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:57.109887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:57.109887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:57.109887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:57.109887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:57.112811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 368/728] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:57.117805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.121530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.122466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.122754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.123053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.139542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.141202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:57.158905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:57.159822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:57.161122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:57.161122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:57.161122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:57.161122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:57.161122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 361/729] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:57.165850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.227137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.273987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63123-c10f-45ae-a564-f05012492d3a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.311798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.312653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.318807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.318807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.318807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:57.318807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.318807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.330480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 362/730] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:57.336729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.364762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff496-bc94-4b45-9816-d05ab776c8ec None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.414821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.415508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.415793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.416071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.416813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:57.417124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.418551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff631d5-a75c-428d-bc17-7a56239afb22 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.431416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 369/731] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:57.436639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1248ad-6f1b-4ad1-a463-033ed687a3b9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.436639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1248ad-6f1b-4ad1-a463-033ed687a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.436639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1248ad-6f1b-4ad1-a463-033ed687a3b9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.436639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 370/732] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:57.437481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1248ad-6f1b-4ad1-a463-033ed687a3b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.485381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78800-c017-4f44-b5d9-972b692ccdc6 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.488508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.507946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.524749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.525929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.526448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.527048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.535204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.536945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.552770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1248ad-6f1b-4ad1-a463-033ed687a3b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-7fb77fff-fab5-44a0-89e6-e8d36b5e8374 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:57.553310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:57.554204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:17:57.555634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:57.558089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 363/733] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:57.559570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.560070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.560539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.577930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:57.579471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:57.593757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.594593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.594908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.595189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.602710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.604191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:57.620045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:57.621146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:57.622050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:57.625736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 371/734] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:57.626586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.656755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 364/735] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:57.658025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.729711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba0624-6971-4117-a556-ebebe7b52fd1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.750186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.765889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.766173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.767211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.767498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.767773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.768626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:57.769039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.770517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.774618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7738-e322-4eee-82d9-7409c9b00b44 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.793067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 372/736] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:57.802303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.816927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.817948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.818428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.818942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.820025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:57.820533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.822286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.841911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 365/737] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:57.843091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.914062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ed581-530d-46c1-b3df-3a5f1717e62e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.947059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d16a-6584-4a2f-b219-c3c4237b3ff1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.949955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.951301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.951301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.951301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.952144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.953611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.975167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 373/738] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:57 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:57.976314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.009322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.010040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.010318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.010640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.031641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.035119 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.132724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ebb-8421-45ba-ba74-5f14d63891ed None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.136672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.138194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.195326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.196364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.197346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.197845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.272391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 366/739] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:58.278701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.294345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.296385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bd2da-6cd4-49e0-a09c-12800fa0f051 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.343494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.352242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.410342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513074-a0d3-4aed-bce4-2b5a1e2f4d37 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.422191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 374/740] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:17:58.424125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1291f9d-8139-4827-ab79-a9f898229137 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.424508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1291f9d-8139-4827-ab79-a9f898229137 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.424881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1291f9d-8139-4827-ab79-a9f898229137 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.427431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 375/741] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:58.428615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1291f9d-8139-4827-ab79-a9f898229137 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.449954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.451079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.451530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.451944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.463026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.464754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-bd824559-af7d-4a3a-b685-d86855129e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:58.486659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:58.487834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:58.488744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:58.488744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:58.488744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:58.488744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:58.489477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 367/742] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:58.490897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.491288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.491659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.508434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:58.509753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:58.551043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1291f9d-8139-4827-ab79-a9f898229137 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.583529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 368/743] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:58.588529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.589390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.589675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.589945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.591995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.597291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.601200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.602839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c8242822-ae08-4457-bec8-6211ea7a84cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:58.623064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:58.624041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:58.624893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:58.624893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:58.624893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:58.624893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:58.625871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 376/744] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:58.626821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3913f0-7959-422f-a0eb-fe9fdc5b5cb7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.627112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3913f0-7959-422f-a0eb-fe9fdc5b5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.627386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3913f0-7959-422f-a0eb-fe9fdc5b5cb7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.628923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 377/745] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:58.629648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3913f0-7959-422f-a0eb-fe9fdc5b5cb7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.636456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.717099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a1503-a9bd-46e1-8000-740c76fbfff1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.736276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3913f0-7959-422f-a0eb-fe9fdc5b5cb7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.753442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.754131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.754412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.754686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.755447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:58.755752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.757137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.769190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 369/746] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:58.770022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.782609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.783453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.783734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.784005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.794518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8aa1b81d-df34-4f7f-a64d-f9c3618a33d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:58.802506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:58.803576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:58.804437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:58.808827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 378/747] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:58.810092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.810385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.810646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.828231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:58.829427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:58.870621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.876483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.881115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce849-c57c-41e7-91ea-568c3a3e5075 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.900613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 379/748] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:17:58.902284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.916793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.917724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.918143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.918567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.919505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:58.919974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.921575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.933944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 370/749] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:58.934973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.009156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b499e-ec8f-4b2c-92e4-a9bafb848ebd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.038349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681460-1931-4289-8cc0-9d78d35ad686 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.045253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.046066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.046333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.046596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.054495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.056504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:59.070434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:59.071415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:59.072445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:17:59.076467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 380/750] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:59.077265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.078633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.079496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.079914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.080681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.081566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.081871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.083278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.096772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 371/751] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:59.097425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.112262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.123447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.182566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f240-c0c7-4450-aa5e-2ab7bc2cfad8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.205437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae3d5-f194-4755-81dd-154c936bbc53 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.219115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.219857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.220102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.220377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.221113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.222486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.236879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 381/752] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:59 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:59.245527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.246360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.246635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.246937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.247794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.254828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.256339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:59.272513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:59.273425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 372/753] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:59.275021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.351671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.390630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ee035-e338-4337-9f69-7733ec91b102 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.397778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88292-0f21-4e81-96cf-97173ff28ff0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.419183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.436022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.436993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.437275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.437544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.444864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.445534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.445812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.446080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.446901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.447212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.448812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.450447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.451935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.464519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 382/754] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:59.465177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:59.476109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:59.476999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 373/755] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:59.479181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.580416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cf7a3-7518-4070-a8ab-311330a6bf8b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.612700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049a18-464f-415f-8932-9a363c9296ff None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.616723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.617042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.617323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.617591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.618389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.618696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.620169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.638689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 383/756] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:59.638689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.650187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.668115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:59.668356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.669721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.670223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.670898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.672353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=cbe289a5fd69404786a12a13e43bd697) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.672819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.675420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.687035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 374/757] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/role_assignments?user.id=cbe289a5fd69404786a12a13e43bd697&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:59.688175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.766676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b23d3-9709-45b2-8f29-96c6fb668193 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.807565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.808666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.809386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.809808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.811309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.811772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.813525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.829333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 384/758] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:59.836349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:59.904766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d6d1-0e43-4e22-af06-3404ef0446ae None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:59.944917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:59.945868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:59.946292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:59.946706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:59.947716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=fdd35b9fb29349c7a22af2380310e6fe) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:59.948170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:59.950413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:59.963260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 375/759] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/role_assignments?user.id=fdd35b9fb29349c7a22af2380310e6fe&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:00.019231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.037624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d863-c951-467d-bb97-fe64f6fc36de None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.074953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.075803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.076083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.076356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.085701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.087324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:00.103431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:00.104441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:00.106393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 385/760] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:00.112073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.178040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.236254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5320e-a3e3-4a11-b715-a8f27332cd8a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.297256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.297980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.298261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.298580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.299457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:00.299765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.301211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88afa5-b8b4-4113-831b-883d542556e5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.327906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 376/761] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:00.333524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.346697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037741e-8ae7-4736-a838-79fa7976ed2e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.347134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037741e-8ae7-4736-a838-79fa7976ed2e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.348976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037741e-8ae7-4736-a838-79fa7976ed2e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.350569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 377/762] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:00.355784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.356238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.356684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.374298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:00.375846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:00.447622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 378/763] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:00.477815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.515034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc1e19-06c0-4efe-baf9-15653879a1e3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.553600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.554999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.555484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.556093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.565669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.567991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.570453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.577308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:00.591972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:00.593078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:00.594151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:00.594151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:00.594151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:00.594151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:00.596283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 386/764] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:00.608041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.684933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccda18-e5e4-4cca-a721-7f73c4f119b6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.720394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.721484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.721914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.722330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.723230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.724744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:00.737274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:00.738200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:00.739078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:00.742133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 379/765] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:00.751949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.794066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894bfa-f322-48c2-9130-e64c33eaf686 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.859249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.862842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15aea-9410-4a28-a97f-221039df68ca None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.869864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.870807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.872145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.872440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.873187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:00.873501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.875048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.900283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.900483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 387/766] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:00.901396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.906216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.906831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.907438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.908113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:00.908633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.910279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.915832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 380/767] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:00.926902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.020387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:01.038287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99805a2e-3f57-429a-82d2-bfb9f211c6b9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.079636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.080703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.080985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.081261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.081985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:01.082296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.083719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.089730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 381/768] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:01.100853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.156477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:01.255228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5f40-8272-4ebb-9fad-32143f8639e4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.305993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64d6c-0b03-40a2-aac2-8fcc83f518cd None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.328451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.329552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.330381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.330910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.346842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.348335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.353013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.353694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.353973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.354245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.355165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] RBAC: Adding query filter params (interface=public, service_id=dfa9247249ba4d7ebd080c59e0ba446a, region_id=RegionOne) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:01.355476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.363885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:01.377131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:01.378046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:01.378966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 388/769] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:01.379449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 382/770] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:01 2022] GET /identity/v3/endpoints?service_id=dfa9247249ba4d7ebd080c59e0ba446a&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:01.384096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.387462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.543711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f554-8850-41db-90fc-ba1806defbc7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.559468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:01.569385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:01.578551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e2de-9164-4b56-bf98-d86368fc75d8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.588417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.589671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.590023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.590362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.591682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.593440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b8d8-1270-420a-937c-9967f92aa3d5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.600648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 389/771] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:01 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:01.602073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bf01e-972c-4c34-8497-63413a662f01 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.602357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bf01e-972c-4c34-8497-63413a662f01 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.602629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bf01e-972c-4c34-8497-63413a662f01 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.608914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 390/772] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:01.611015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.611359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.611704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.631614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:01.633270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:01.660945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.661747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.662024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.662296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.663126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:01.663542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.665098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.697447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 383/773] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:01.703844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.716009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 391/774] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:01.736877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.855488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1bc1-a339-4961-ba1d-4421dbaf45ea None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.867180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:01.894361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.895231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.895512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.895786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.896175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42833-f73f-4186-82d2-024b20e7b1c8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:01.896446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.897838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:01.912725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:01.915100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:01.917063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:01.922829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 392/775] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:01 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:01.922829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:01.931878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:01.932826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:01.933149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:01.933404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:01.935423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=1876435c9cdf4e11a6d193017d53ed49, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:01.936871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d657dc-0b97-4ca8-bb96-0995e878a9fa None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:01.956093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 384/776] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:01 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:02.053606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17416a-9959-435c-bd3a-a98392e83fc6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.105420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91440-7d18-43d8-b4f3-0a386c708ad4 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.105702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91440-7d18-43d8-b4f3-0a386c708ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.105975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91440-7d18-43d8-b4f3-0a386c708ad4 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.107378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 385/777] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:02.108534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.109481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.109914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.110475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.111396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:02.111974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.113567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.122567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.122567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.122567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.123188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 393/778] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:02.125881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.159617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:02.163389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:02.178016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.182244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.280492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 386/779] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:02.281766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1967a4-095e-4840-bb0f-c417d0e43312 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.303758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.329936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.331242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.331593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.331932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.332719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] RBAC: Adding query filter params (type=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:02.333099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.334546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.342831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 394/780] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:02.346521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.461407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507d566-457a-4740-b5a6-9371e7960b58 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.496342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.497163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.497442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.497715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.508390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:02.516321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:02.517244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:02.518047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 387/781] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:02.521383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.525586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.536814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8b9d-6409-4995-abf9-b323c21d7984 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.559242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.574931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.575608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.575889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.576169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.576998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] RBAC: Adding query filter params (interface=public, service_id=d80d81a9d9654bd0ac5c0c628eb8d63f, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:02.577312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.578707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f782510-ab8f-4c2e-ae2b-796e5ff7b885 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.587599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 395/782] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/endpoints?service_id=d80d81a9d9654bd0ac5c0c628eb8d63f&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:02.589085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae28d4-0361-4239-ba89-e56bf9acea3f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.589470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae28d4-0361-4239-ba89-e56bf9acea3f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.589747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae28d4-0361-4239-ba89-e56bf9acea3f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.595086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 396/783] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:02.595913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae28d4-0361-4239-ba89-e56bf9acea3f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.637321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb3b48-3564-4c31-99c3-18bb54eb2fee None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.674517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.675632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.676184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.676668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.677766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:02.678305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.680004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313430d-19be-42f1-9702-370b8ff89a8e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.689995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 388/784] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:02.691781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.692260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.692814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.700674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae28d4-0361-4239-ba89-e56bf9acea3f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.711703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:02.713306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:02.736167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.736854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.737132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.737402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.738102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.739627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.745618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 397/785] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:02.746571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.777995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.807458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:02.821490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 389/786] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:02.872328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:02.878212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc580-1edc-4e34-9f7f-5c8fc6d89902 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:02.918909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:02.919831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:02.920117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:02.920390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:02.933478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:02.935005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:02.953813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:02.954733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:02.956034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:02.956034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:02.956034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:02.956034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:02.956034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 398/787] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:02.962212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.015696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2c6af-98da-4b2f-b07b-600902831e4e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.057993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.059236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.059726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.060217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.065759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.075248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:03.084938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:03.085918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:18:03.086729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:03.089558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 390/788] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:03.093559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285e39-05b1-4cc8-9807-ce0c89cedaaf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.095724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.132674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.133725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.134265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.134766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.136188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:03.136802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.138434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.155769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 399/789] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:03.161754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.162166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.210669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406ed76-e814-4bf8-ad56-f53cec907d43 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.253978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.254654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.254961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.255235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.255989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:03.256296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.257685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.279563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 391/790] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:03.286384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.369406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415865-01b2-48ff-9b3c-a6cbfa92dcdb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.435188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344aa7-44f5-47de-ab04-d98f1152c416 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.436252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.437078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.437353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.437617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.457927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.459100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.459897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.462965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:03.484291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:03.485605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:18:03.486750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:03.492916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.493907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.499169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.499362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 400/791] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:03.499712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.503729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.524014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.526236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:03.560296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:03.561389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:03.562468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:03.562468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:03.562468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:03.562468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:03.572075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 392/792] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:03.573920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.652712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2e4e-3782-44f7-a5f6-e25c3daaebb8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.697464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.698165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.698674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.698999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.699858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:03.700172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.701880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.737566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 401/793] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:03.744705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.750144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb003a-abef-41d6-b79a-e44b26745fca None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.808896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.809584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.809868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.810145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.812952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:03.813267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.814659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.840789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 393/794] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:03.848639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.859173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.899724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.937891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75dd9-0ade-49dc-bac7-4fbb5f0910e1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.999895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.000891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.001179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.001451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.019977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.021523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.029308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12fa79-1b8d-468e-90c9-12987289851a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:04.063130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:04.064094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:04.064993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:04.064993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:04.064993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:04.064993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:04.064993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 402/795] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:04.069160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.070212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.070341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.070842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.071289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.079904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.082101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:04.099064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:04.100038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:04.100974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:04.103409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 394/796] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:04.109253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.184809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaed97-64c6-4d44-bd0c-d63b7525eed1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.194299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.208450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.222278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1284e-bc9d-4737-bf7a-59191cd72744 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.224998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.225934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.226414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.226916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.227844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:04.228364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.230131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc098069-b1bf-4713-87c1-1621d7cd6f96 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.243347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 403/797] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:04.245054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbacc-6994-40ce-b5c5-3b1a1c44d654 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.245687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbacc-6994-40ce-b5c5-3b1a1c44d654 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.246184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbacc-6994-40ce-b5c5-3b1a1c44d654 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.252324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 404/798] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:04.253451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbacc-6994-40ce-b5c5-3b1a1c44d654 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.258831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.259520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.259805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.260089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.261016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:04.261336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.262807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826176-ed0c-4b59-9a3e-61c39832cf27 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.282325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 395/799] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:04.287730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.288242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.288614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.305385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:04.306675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:04.381329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbacc-6994-40ce-b5c5-3b1a1c44d654 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.381772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 396/800] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:04.382715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.422316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.423663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.424438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.425159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.436456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.437894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:04.456760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:04.457653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:04.458572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:04.460294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 405/801] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:04.465306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.497962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.498707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.534380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592d9ab-112d-4e0b-9f4c-bf17fec1e888 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.581972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.583320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.583785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.584207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.584681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2287-a0ac-42cb-972d-4dcf85a1621d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.601216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.603472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.622266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.623125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.623408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.623679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.624338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:04.625351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:04.626152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:04.627469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:04.627469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:04.627469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:04.627469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:04.627882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.627953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 397/802] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:04.631881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-27173666-3ba4-46dd-906e-1568deb0c977 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:04.639234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:04.640131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:04.640972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 406/803] 10.222.0.57 () {56 vars in 1129 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:04.641811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe1700-13f2-4044-b7de-37128cfd4d76 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.642736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe1700-13f2-4044-b7de-37128cfd4d76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.642736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe1700-13f2-4044-b7de-37128cfd4d76 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.647620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 407/804] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:04.647620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe1700-13f2-4044-b7de-37128cfd4d76 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.741021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b54e0-d482-44f1-b255-928bcce51b91 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.746378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.759039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe1700-13f2-4044-b7de-37128cfd4d76 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.769337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:04.780193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.780879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.781162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.781438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.782670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:04.783032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.784491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.800412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.801107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.801578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 398/805] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:04.801697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.801958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.802269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.802691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:04.803030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.804403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52005d-8721-4933-8066-dcef91a588ce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.818524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 408/806] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:04.820188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.820538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.820878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.839154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:04.840816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:04.916587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03320ec4-c7db-47c3-b10c-3391d8eb8daa None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:04.923097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 409/807] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:04.926844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:04.961119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:04.961808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:04.962090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:04.962364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:04.963107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:04.963413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:04.964947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:04.969843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 399/808] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:04.970431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.023007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.035508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.058293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b01f1-f51a-440b-b16b-dfecce5bdcc6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.070871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c5f-a6df-45bd-b19c-f399820f970e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.094757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.095688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.095965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.096235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/cbe289a5fd69404786a12a13e43bd697/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.098239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=cbe289a5fd69404786a12a13e43bd697, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.099724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.105113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.105953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.106208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.106478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.112821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 410/809] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:04 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/cbe289a5fd69404786a12a13e43bd697/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:05.113604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.121144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.122882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:05.139176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:05.140406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:05.141646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 400/810] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:05.142133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.231923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675647-a69c-43d3-9355-ecd999866741 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.271111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441f74-cd9a-46e8-9931-851c357fe019 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.271782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.272611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.272886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.273215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.286588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:05.288050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e1a90d89-1a04-4f79-9a60-4811ed8bc4f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:05.294770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:05.295945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:05.297034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 411/811] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:05.297886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd18-82dc-4ecb-9b3f-71b1f6f103e7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.298221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd18-82dc-4ecb-9b3f-71b1f6f103e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.299942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd18-82dc-4ecb-9b3f-71b1f6f103e7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.299942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 412/812] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:05.300667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dd18-82dc-4ecb-9b3f-71b1f6f103e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.304220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.319707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.320405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.320677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.320957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.321671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:05.321982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.323459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.330963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 401/813] 10.222.0.57 () {56 vars in 1124 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:05.330963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.411470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dd18-82dc-4ecb-9b3f-71b1f6f103e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.434525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734baaed-af6e-4398-806b-2df7eec47359 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.449537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.450481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.450763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.451064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.452025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:05.452333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.454079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8c4c-498e-41a3-8586-76afe0888639 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.469482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.474842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 413/814] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:05.475008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.475008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.475008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.475008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:05.475296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.475375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.475458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.475458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.475604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.483782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 402/815] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:05.484760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.491154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:05.492507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:05.528271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.551929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.563171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 414/816] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:05.571661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.607093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03da2d-757a-4cef-bffb-0c2ef9ae80d9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.641163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.641924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.642275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.642621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.643481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.644929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.678810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 403/817] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:05.678810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.679084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173ec5-179b-440f-9b75-bdeb1a0affb7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.726996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.727925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.728279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.728706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/fdd35b9fb29349c7a22af2380310e6fe/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.747554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=fdd35b9fb29349c7a22af2380310e6fe, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.749157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.769011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 415/818] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:05 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/fdd35b9fb29349c7a22af2380310e6fe/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:05.769990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.836469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.857107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.869916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee0ba8-93eb-44e2-95aa-0e1608777c8f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.915465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.916274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.916559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.916836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.922570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bed6a-724d-4756-b3e1-191dc86fc2bc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.930101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.931670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:05.951690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:05.952641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:05.953499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:05.953499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:05.953499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:05.953499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:05.953499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 404/819] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:05.960441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.977052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.977949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.978399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.978684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] PATH_INFO: `/v3/services/network` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.979994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.981686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:05.997725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:05.998808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:18:05.999744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:06.000475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 416/820] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:06.006997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.085760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ec9-a747-4708-96d7-9314078083a9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.123468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bc822-79f1-4f07-a2b3-2c1f22894850 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.125404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:06.131132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.131825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.132116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.132396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.133800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:06.134558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.136615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.154825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 405/821] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:06.159096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.170402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:06.170694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.171786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.172082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.172354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.173110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:06.173415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.174818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.180730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 417/822] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:06.186396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.317266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c1ca-92ff-42f8-b38b-5a05e10a8507 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.336868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f8036-b8ec-4255-beb6-86c11595f13c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.371767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.372645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.372924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.373195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.384343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.385823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.402734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.403427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.403790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.404068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.404780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] RBAC: Adding query filter params (type=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:06.405135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.406515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:06.415581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:06.416497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:06.417451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:06.418438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 406/823] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:18:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:06.424933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 418/824] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:06.425845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.439800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.480929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:06.559101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:06.607996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b15bbc-b324-4006-9329-f6f3f671955d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.621194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a454-3038-4102-8bbe-416823238d5f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.669019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.669700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.669978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.670247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.671014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.672413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.681177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.681865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.682138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.682407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:06.683306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:06.683613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:06.685049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.711455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 419/825] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:06.724536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 407/826] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:18:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:06.730467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:06.851027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:06.884892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c948aa-a0cb-4f28-8492-142ade391f7a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:06.936977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:06.937757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:06.938037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:06.938309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.018958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.020792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade27e5-7542-4583-b6f8-c51f232dbc00 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.109814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.131753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 420/827] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:07.137865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.247014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb403db6-717b-46d5-9c24-22ad74839980 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.273117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.285669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.286510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.286807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.287092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.294368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e81f4-6bd4-4faa-8911-3dd1215dc585 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.294692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e81f4-6bd4-4faa-8911-3dd1215dc585 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.294957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e81f4-6bd4-4faa-8911-3dd1215dc585 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.296589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 421/828] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:07.302179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.302708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.303226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.303415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.304914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:07.323564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:07.324519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:07.326454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:07.326454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:07.326454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:07.326454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:07.326454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 408/829] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:07.326742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:07.329395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:07.331116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.401320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 422/830] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:07.424008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.432457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152a82-ae22-4021-a1a1-1d214872aab2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.467821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.468500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.468783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.469064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.469788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:07.470098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.471521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.484119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 409/831] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:07.489657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.525628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.531051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03452e77-b108-425f-94f9-e8aec0f9e2b7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.545964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.570254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.571520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.571947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.572364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.584224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:07.592728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:07.593837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:07.594812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:07.595466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cedf2-5807-45f8-b378-2a785c9fcb06 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.597540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 423/832] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:07.606188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.636282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.637106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.637492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.637768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.647366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.650084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:07.669003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:07.669896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:07.670771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:07.672407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 410/833] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:07.677847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.723205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535993c-ff3e-4a1a-8222-811dda4aff97 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.758775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.759865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.760367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.760919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.761871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:07.762378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.764013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.773888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 424/834] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:07.780719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.785305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.791601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a99c40-1f9f-49d7-a981-0fb0f0217f12 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.817748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:07.832810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.833583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.833870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.834245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.835101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:07.835423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.837013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.855093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 411/835] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:07.856703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.888958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570ac-303c-40fc-a17f-bfcd7321b40e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:07.924494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:07.925233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:07.925519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:07.925796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:07.936659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:07.938142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:07.956527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:07.957424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:07.959212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:07.959212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:07.959212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:07.959212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:07.962838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 425/836] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:07.963731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:07.965626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ffcb7-876a-41c9-bbcd-5ed7baa50752 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.003477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.004191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.004480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.004759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.005690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:08.006015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.007584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5417435-7149-400a-8996-f04c985c94ab None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.022943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 412/837] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:08.056676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.078953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f1c3-04d3-4d27-a428-3ccbfeb2a560 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.117694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.118402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.118684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.118998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.119751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:08.120094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.121524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.129314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1435c-7ef4-49f7-9285-ae7a6d44bfc5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.129714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1435c-7ef4-49f7-9285-ae7a6d44bfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.130000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1435c-7ef4-49f7-9285-ae7a6d44bfc5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.131780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 413/838] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:08.135434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 426/839] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:08.138302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d993-006f-46a4-9210-09dda7c2914f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.138302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d993-006f-46a4-9210-09dda7c2914f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.138302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d993-006f-46a4-9210-09dda7c2914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.141121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.157587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-57a8d993-006f-46a4-9210-09dda7c2914f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:08.159307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-57a8d993-006f-46a4-9210-09dda7c2914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:08.177962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.242823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 414/840] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:08.244260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b6b9-4eea-4ede-b3f9-bddc4f061ed6 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.244547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b6b9-4eea-4ede-b3f9-bddc4f061ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.244818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b6b9-4eea-4ede-b3f9-bddc4f061ed6 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.246275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 415/841] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:08.251401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.251728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.251842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da946607-4ade-4efb-87ef-c9bcc13115a3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.252005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.289750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.290598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.290914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.291189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.299914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.301459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:08.317742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:08.318745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 427/842] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:08.325213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.335954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.389723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:08.390936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:08.438066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291fbe-6ec4-40db-b8a0-a744cb23b01e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.466902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 416/843] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:08.466902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.487130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.488194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.488620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.489064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.500434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:08.508511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:08.509451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:08.510321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 428/844] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:08.511500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.567151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.584704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.587886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ffc2-3102-47db-bb86-07b67f719616 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.620689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f6209-e9bd-4655-a68c-14024825900a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.625405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.626093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.626375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.626642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.627555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:08.628363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.630244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.650758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 417/845] 10.222.0.57 () {56 vars in 1135 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:08.651669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.661206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.662027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.662305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.662574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.663266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.664634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:08.676848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:08.677839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:08.678638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 429/846] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:08.679456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.768926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17094-b968-4371-8630-095e9194c657 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.801065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e539-29cf-40f2-b7de-d44ed85b2bfe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.814947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.815618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.815898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.816169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.816911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:08.817211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.818574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.824244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.828233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 418/847] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:08.829055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.836612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.844510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.845339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.845624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.846280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.922074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.923595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.935583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44627ef-35ad-4abf-9ca6-fde3a58c51fc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.969547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.970216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.970493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.970763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.971488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:08.971798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.973161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.977692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 419/848] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:08.978453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.032945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 430/849] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:09.038633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.048678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.072308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.091060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c153-e4ea-46b3-8c61-d2581135cba8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.125099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.126271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.126553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.126852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.139755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.142345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.148677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd37be-05a1-4174-b0c8-d181cfeb0aeb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:09.160050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:09.161059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:09.161971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:09.161971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:09.161971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:09.161971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:09.161971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 420/850] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:09.162262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.192222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.192912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.193197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.193471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.194197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:09.194503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.195942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.201099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 431/851] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:09.201719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.291687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70e80-e400-4a2d-8843-e7218cdc0bc5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.313930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.322916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.332530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0118bd-5ef3-4fa3-9353-cc189a850af9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.339862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.341048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.342054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.342551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.358318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.360884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.373836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.374521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.374895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.375110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.375910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:09.376269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.377656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:09.381626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:09.382476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:09.383369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:09.383369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:09.383369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:09.383369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:09.386909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 421/852] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:09.388536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.394229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 432/853] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:09.399779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.508484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f96e0-4d18-4028-bd34-7a214927f716 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.525094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7b493-1f9b-45b7-bb29-94a2ff13c42d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.547050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.548165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.548448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.548724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.549455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:09.549762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.551183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.565554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.566028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 422/854] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:09.567128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.567551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.567955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.571765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.581751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.583586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:09.601592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:09.602635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:09.603597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:09.605051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 433/855] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:09.610763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.610931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.630555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.689770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cb1f2-a536-42af-8c5d-a5d53f481320 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.727025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826012ce-c8d6-4dc8-a0c3-0781564529bc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.728673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.730640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.731177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.731669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.740788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.743182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:09.762184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:09.763132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:09.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:09.764443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.764443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.764443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.764910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.765986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:09.766398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.766926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 423/856] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:09.772231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.775089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.807141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 434/857] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:09.809032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.884993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.891126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:09.899119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9bd1b-f408-42d8-bc4d-9b8c867d646c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.921082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973a1d-bf29-4d3a-a9a7-a40f4a2267af None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:09.942138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.942831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.943129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.943394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:09.944191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:09.944636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:09.946608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:09.961879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:09.963210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 424/858] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:09.967866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:09.968214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:09.968540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:09.968659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.046610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.048224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.097445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacbb7-5ea5-48fd-b280-337b637feb85 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.121809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.139407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.140084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.140364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.140635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.141603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=cbe289a5fd69404786a12a13e43bd697) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:10.141919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.143408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e056a-46d9-4739-984c-e9661c08cb25 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.158883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 425/859] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/role_assignments?user.id=cbe289a5fd69404786a12a13e43bd697&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:10.158883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecd73-a486-4a50-82e4-0581ee171e54 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.158883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecd73-a486-4a50-82e4-0581ee171e54 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.158883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecd73-a486-4a50-82e4-0581ee171e54 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.158883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 426/860] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:10.166910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.167302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.167650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.172125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 435/861] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:18:10.173151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.186945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:10.188182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:10.197031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.277811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 427/862] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:10.300675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.317581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6426-062b-4b04-9976-fe2236390441 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.365580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.367014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.367496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.367975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.382402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.383937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:10.405536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:10.406455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:10.407392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:10.407392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:10.407392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:10.407392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:10.407392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 436/863] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:10.413631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.432235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6750d5a-7cae-484d-80e2-25dd48617e92 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.440967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.472874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.473537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.473817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.474087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.475028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.476606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:10.490991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:10.492000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:10.492852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 428/864] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:10.498389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.510660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.556791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4841c7-df34-47ae-9afc-5bbb3f4e8f71 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.608088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.609758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.610245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.610754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.611789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:10.612309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.614611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.625888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602d2c-6b37-4d9d-b66c-0bbbbff400c9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.632087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 437/865] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:10.638376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.665528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.666202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.666479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.666748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.667537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:10.667838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.669475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.678634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 429/866] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:10.679607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.742061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.758886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e071f-ba6c-42a5-9056-04fc6c6f7875 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.767606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.803246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.804140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.804332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.804601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.806910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5692e5-36fa-4cee-9ee2-ebbfc7560180 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.811884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.813345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:10.827821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:10.828722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:10.829636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:10.834467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 438/867] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:10.835354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.847975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.848969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.849483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.849992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.851056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:10.851618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.853194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:10.862930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 430/868] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:10.945465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b190-9d1e-4cfd-aaa2-a9b31051bd16 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:10.983673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:10.984351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.984625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.984897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.985755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:10.986061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:10.987598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697542ce-0729-473b-81f8-9042e90eb022 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.001694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 439/869] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:11.007744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.113976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ed18-1412-408e-9e93-1394b3b18aa9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.148276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.149299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.149749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.150183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.151261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=fdd35b9fb29349c7a22af2380310e6fe) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:11.151741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.153341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0538-829d-4806-aace-205ad130fc46 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.155352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.161274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 431/870] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/role_assignments?user.id=fdd35b9fb29349c7a22af2380310e6fe&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:11.393978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50de66-cd42-4c7d-b810-f2eb4dc5ccca None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.394403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50de66-cd42-4c7d-b810-f2eb4dc5ccca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.394578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50de66-cd42-4c7d-b810-f2eb4dc5ccca None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.396086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 440/871] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:11.402157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616905-356f-4485-ae0a-226fb84e4336 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.402726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616905-356f-4485-ae0a-226fb84e4336 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.403245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616905-356f-4485-ae0a-226fb84e4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.423911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-95616905-356f-4485-ae0a-226fb84e4336 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:11.425439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-95616905-356f-4485-ae0a-226fb84e4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:11.499694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 432/872] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:11.523541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50de66-cd42-4c7d-b810-f2eb4dc5ccca None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.527997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.633310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50de66-cd42-4c7d-b810-f2eb4dc5ccca None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.667579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.668169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.668447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.668717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.669442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.670836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9a722-84f9-4942-a28b-14ee4e6b2468 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.688325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 441/873] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:11 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:12.303082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a8ac-ed03-4eb0-b86c-333a0bbbded8 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.303727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a8ac-ed03-4eb0-b86c-333a0bbbded8 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.303727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a8ac-ed03-4eb0-b86c-333a0bbbded8 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.305263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 433/874] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:12.310825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.311207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.311384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.328096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:12.329301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:12.392114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:12.409245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 442/875] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:12.431200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a8ac-ed03-4eb0-b86c-333a0bbbded8 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:12.534332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a8ac-ed03-4eb0-b86c-333a0bbbded8 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:12.560926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:12.569495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:12.570315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.570597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.570912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.571574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:12.572972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:12.585300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:12.586268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:12.587116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:12.590884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 434/876] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:12.595922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:12.697935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e9bc-70dd-4b7e-9eec-0f07d1a9caa5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:12.734229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:12.734945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.735221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.735488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.736197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:12.736499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:12.737874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c264c-2a2d-4ca5-867d-0cbbf991a890 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:12.742905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 443/877] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:12.748648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:12.856397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90f88-b248-4bed-84d3-89bba78d9fa3 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:12.893003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:12.894072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.894548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.895111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.896157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:12.896655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:12.898288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cf84f-0bd4-4b0c-bbcb-ed1074444799 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:12.903649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 435/878] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:12.932631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877b7b0-4c40-4cd6-ad7b-4a3d055a3131 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.932994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877b7b0-4c40-4cd6-ad7b-4a3d055a3131 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.933197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877b7b0-4c40-4cd6-ad7b-4a3d055a3131 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.934941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 444/879] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:12.940732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1ad9b-0b50-49a3-84c5-1578566ab702 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:12.941044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1ad9b-0b50-49a3-84c5-1578566ab702 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:12.941309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1ad9b-0b50-49a3-84c5-1578566ab702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:12.959665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f5f1ad9b-0b50-49a3-84c5-1578566ab702 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:12.960914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f5f1ad9b-0b50-49a3-84c5-1578566ab702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:13.016041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:13.035132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 436/880] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:13.057891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877b7b0-4c40-4cd6-ad7b-4a3d055a3131 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:13.119062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:13.167758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877b7b0-4c40-4cd6-ad7b-4a3d055a3131 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:13.205207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:13.205900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.206182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.206460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.207228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:13.208627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce876e9a-2cd6-497a-a9d9-2fe855383547 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:13.224820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 445/881] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:13 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:13.398269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e63be-f5bb-435b-a9da-d9f5610ae4e5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.398822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e63be-f5bb-435b-a9da-d9f5610ae4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.398929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e63be-f5bb-435b-a9da-d9f5610ae4e5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.400518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 437/882] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:13.409699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.410196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.410289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.427899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:13.429110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:13.504631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 446/883] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:13.527678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e63be-f5bb-435b-a9da-d9f5610ae4e5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:13.636015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e63be-f5bb-435b-a9da-d9f5610ae4e5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:13.670601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:13.671812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.672286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.672760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.683610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-724e6f32-c5ab-4f71-9284-813bf270fbac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:13.691996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:13.692872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:13.693667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:13.696351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 438/884] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:13.702871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:13.745581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:13.808865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04069dd8-1b47-465e-9e76-76cd218a83c2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:13.825561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73fa7e-e538-48a0-bcad-291c268129fe None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.825982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73fa7e-e538-48a0-bcad-291c268129fe None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.826365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73fa7e-e538-48a0-bcad-291c268129fe None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.828128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 439/885] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:13.833351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.833792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.834172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.844247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:13.844930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:13.845209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:13.845484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:13.846236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:13.846543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:13.848081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:13.852864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:13.854916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:13.856380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 447/886] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:13.862036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:13.916649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:13.955316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 440/887] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:13.973934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:13.983305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c167b-e4c1-4b7e-802d-3024d8697121 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:13.984848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.020552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.021393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.021675 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.021944 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.032878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.034356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:14.052681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:14.053645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:14.054511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:14.054511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:14.054511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:14.054511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:14.054511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 448/888] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:14.060749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.080367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356507b-b559-406b-a83b-b9a0168092e3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.118027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.119222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.119709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.120330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.121284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.122859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:14.136176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:14.137155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:14.137955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:14.145533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 441/889] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:14.146823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.168777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9e1e-b8dc-493f-8d71-588c14b06c54 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.192798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.207374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.208495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.208994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.209463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.210470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.211103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.212682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.229602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 449/890] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:14.230847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.251179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.252729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962fcd-d179-4da5-9e4e-51a226767510 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.287260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.287991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.288212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.288480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.289184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.289488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.291001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.295863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 442/891] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.302007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.338173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c9087-8582-4870-aaaf-6d4e0d673099 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.374384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.375515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.375947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.376362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.384104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.385951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:14.403024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:14.404116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:14.405058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:14.407466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 450/892] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:14.413358 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.414743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b568f-1c19-4358-aaf3-532ccf2cb67b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.419677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.465652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.466245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.466526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.466838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.467539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.467846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.469842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.482939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 443/893] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:14.487263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.512031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.541558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89176b-dd07-4099-9407-78be44312359 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.581305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.582041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.582323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.582730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.583660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.583974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.585524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.595037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb5f-a1f3-43be-9de0-370aacd1c874 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.609450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 451/894] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.610696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.630874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.631553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.631835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.632106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.632995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] RBAC: Adding query filter params (interface=public, service_id=8a45111e054c44d89b5d074e0619d2d4, region_id=RegionOne) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.633310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.634794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.640635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 444/895] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/endpoints?service_id=8a45111e054c44d89b5d074e0619d2d4&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.650809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.684494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.738093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81080aaa-341d-430b-8ba2-012589a8b076 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.772613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.780598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8e38-603b-4bd9-b1d6-6abbbaf56b67 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.781516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.782339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.782821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.783171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.827197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.828568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.828999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.829419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.831028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.832823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.846409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 445/896] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:18:14.862455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.864012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b415a0-b498-4faf-bfc6-19a5727ad425 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.980863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 452/897] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:14.986857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.013241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de89c9-1d55-45eb-b4e4-a1a41d20d1e1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.013423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de89c9-1d55-45eb-b4e4-a1a41d20d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.013870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de89c9-1d55-45eb-b4e4-a1a41d20d1e1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.015649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 453/898] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:15.024201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.024830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.025353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.043687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:15.045429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:15.082636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.100590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.108028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e7982-bf05-4f1e-8ae8-d97593d9db41 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.138994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 454/899] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:15.148605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.149676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.150198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.150671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.162076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.164924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.166837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:15.185518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:15.186459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:15.187347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:15.187347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:15.187347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:15.187347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:15.189750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 446/900] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:15.198846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.268674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36a632-6e85-44df-8fec-651362e4062c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.300212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ab93-47dc-4abb-9b81-811afe0a952b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.308399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.309094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.309379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.309658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.310601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.312148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f175415-448b-4039-8d21-3cfe250a782d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.334620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 455/901] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:15 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:15.351069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.351883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.352226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.352497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.353250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:15.353553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.355024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.370432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 447/902] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:15.374213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e975-6f8e-4ffd-b36f-f41cdc881906 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.374500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e975-6f8e-4ffd-b36f-f41cdc881906 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.374772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e975-6f8e-4ffd-b36f-f41cdc881906 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.376037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.376790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 456/903] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:15.380974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.383395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.383896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.384941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.405771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:15.407759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:15.449495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.506549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 457/904] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:15.516154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd8a0-5250-4bb7-b5b7-0911ba982393 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.529295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.557083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.558209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.558497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.558794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.566222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.567558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:15.582054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:15.582991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:15.583855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 448/905] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:15.589346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.663417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.667811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88610-5e49-4960-9cae-b7981626571a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.711950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac701e-1478-47ed-8b92-4eebccac68ef None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.716985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.717894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.718175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.718446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.719508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.722373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:15.740111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:15.741050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:15.741857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 458/906] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:15.747218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.753269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.754162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.754619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.755120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.756102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:15.756587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.758210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.770378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.771848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 449/907] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:15.781131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.887157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346311c-0845-4557-b8fa-dbe794571c45 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.904229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23539193-ab4f-4c2f-a12b-fe9218681c21 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:15.924286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.925073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.925421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.925830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.926551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:15.926953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.928449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.933975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 459/908] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:15.942114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:15.943090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:15.948726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:15.949534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:15.949917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:15.950336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:15.951541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] RBAC: Adding query filter params (role.id=0308233c99c1480395750f4a7eac43c6, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=fdd35b9fb29349c7a22af2380310e6fe) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:15.952187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:15.954008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:15.966202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 450/909] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/role_assignments?user.id=fdd35b9fb29349c7a22af2380310e6fe&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=0308233c99c1480395750f4a7eac43c6 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:16.035966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:16.058345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0cab8-6bb2-4ffc-8d6f-6b08892fec69 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:16.094884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:16.095586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.095865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.096138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.096869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:16.097162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:16.098604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:16.104908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 460/910] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:16.110953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:16.215288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd891-5d87-4539-95ff-b62b52cdcd91 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:16.248617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:16.249283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.249555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.249826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.250602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] RBAC: Adding query filter params (interface=public, service_id=235139920fb64c12808c7479877b3388, region_id=RegionOne) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:16.250939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:16.252298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07adb9b-5aef-456d-b52e-b1a0651f5ef6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:16.257627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 451/911] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:16 2022] GET /identity/v3/endpoints?service_id=235139920fb64c12808c7479877b3388&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:16.263259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:16.364080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b49ad5-7f8f-4541-853d-4763b4ca6d97 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:16.397854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:16.398571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.398881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.399247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.399943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:16.401344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9b11-e14b-436d-ba11-d7534673d363 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:16.409421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 461/912] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:16 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:18:16.947821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a807a-68eb-422c-acfa-f577bef7bd2e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.948383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a807a-68eb-422c-acfa-f577bef7bd2e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.948383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a807a-68eb-422c-acfa-f577bef7bd2e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.949912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 452/913] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:16.955686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.956490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.956966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.973991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:16.975518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:16.977762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.043153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 462/914] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:17.065595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a807a-68eb-422c-acfa-f577bef7bd2e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.123627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.178587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a807a-68eb-422c-acfa-f577bef7bd2e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.216444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.217365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.217746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.218117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.219132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.221170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:17.236137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:17.237096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:17.237926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 453/915] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:17.243686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.340347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5859d-d8c4-40be-9990-1011a75589f6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.374198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.374899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.375178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.375456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.376154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:17.376455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.377821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60137237-0950-4f99-9c63-0d500fd2ddf5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.382982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 463/916] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:17.388567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.446850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05dae-cbee-4381-a69c-c7130513b253 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.447220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05dae-cbee-4381-a69c-c7130513b253 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.447411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05dae-cbee-4381-a69c-c7130513b253 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.449075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 464/917] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:17.455140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.455515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.455859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.462487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.483457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:17.484949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:17.499994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77e11-053a-49c5-9cb9-cf5b35f85152 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.516900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.536319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.537159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.537531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.537872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.538660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:17.539092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.540553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.545944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 454/918] 10.222.0.57 () {56 vars in 1114 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:17.551664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.566669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 465/919] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:17.590089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.666271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a699f-5fe6-479f-8507-59eb1848e604 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.702196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.703172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.703597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.704016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.705364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.706946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.719515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd37d6-401e-4e59-9273-ef4722c4e7bf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.730248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 455/920] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:18:17.752739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.765174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.766032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.766322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.766600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.767313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.768762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:17.788077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:17.789145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:17.790252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 466/921] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:17.797729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.847984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.919052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7d56-f06c-46d8-817e-d30310e2c868 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.954475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.955617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.955816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.956088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.956797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:17.957102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.958497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baef8cb-b83d-43df-b452-dfd241f0c7e6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.966896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 456/922] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:17.969829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.086287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061d8b-c80f-4227-aa99-1bd82a2c724e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.121085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008350-bcbd-4d66-9bd9-dab2d5f0b1a0 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.121405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008350-bcbd-4d66-9bd9-dab2d5f0b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.121637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008350-bcbd-4d66-9bd9-dab2d5f0b1a0 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.123344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 457/923] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:18.125688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.126351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.126627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.126942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.127667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:18.127970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.129341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.136189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.136959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.137443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.138836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 467/924] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:18.147252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.159502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:18.160751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:18.217114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.240923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 458/925] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:18.262669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.264108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2615a-d163-4562-8688-7a454cdce0f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.297777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.300701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.301599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.302097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.302571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.303649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] RBAC: Adding query filter params (interface=public, service_id=83ac7d5583ff422cb5eb3aea75e3ca2a, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:18.304150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.305683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.312727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 468/926] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/endpoints?service_id=83ac7d5583ff422cb5eb3aea75e3ca2a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:18.318471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.374688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee674-29c8-4c3f-9702-c3b012c063f4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.410954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.411793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.412073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.412344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.423220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:18.431438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:18.432443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:18.433286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:18.436567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f923dfa-65eb-4474-a805-8e820f0d2eb1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.437935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 459/927] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:18.439272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.469653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.473511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.475168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.475168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.475168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.476180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.478136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fa3e8-1188-43d5-af47-82ead8a4ddcc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.493184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 469/928] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:18:18.501178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7da8-b23a-4afe-8765-24a223cb6b6e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.501485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7da8-b23a-4afe-8765-24a223cb6b6e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.501741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7da8-b23a-4afe-8765-24a223cb6b6e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.507806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 470/929] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:18.509302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.509596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.509876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.528472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:18.529725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:18.546919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.558286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fdc4-42d2-4bda-8aa4-64f1eca57703 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.605437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.606134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.606414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.606690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.607513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:18.607855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.609364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.618015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 471/930] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:18.624579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 460/931] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:18.626035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.642506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.765526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbd821-3041-417a-9ebb-65c77b548b85 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.768647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525de384-8474-4e9b-bb47-e7d9d95a0dba None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.783934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.807294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.808370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.808648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.808925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.810094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.811096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.811381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.811653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.812317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.813707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.824189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.825919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:18.832723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:18.833647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:18:18.834489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:18.836438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 461/932] 10.222.0.57 () {56 vars in 1132 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:18.842043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:18.851123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:18.852002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:18.852871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:18.852871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:18.852871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:18.852871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:18.852871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 472/933] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:18.858425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.866160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:18.957447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45176c02-0262-4bc8-a5e2-7c5a35dd1fc3 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.990395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83ed36-7d17-4da5-8154-cc5e18b6a279 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.005440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.006452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.006995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.007469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.009221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:19.009738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.011374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.021932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 462/934] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:19.023274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.026346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.027069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.027349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.027615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.029124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:19.029124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.030008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.042447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 473/935] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:19.051767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.082549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.125814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.152003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f996646-9302-4ef5-a3fb-b638e20aff9d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.171743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130e48-91e9-4454-8254-a1a1e0778986 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.187851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.188649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.189026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.189421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.190203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:19.190863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.192101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.197251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 463/936] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:19.202765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.214313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.215303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.215684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.216067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.224385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.225953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:19.241113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:19.242221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:19.243421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:19.244881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 474/937] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:19.253807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.319327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e97a-d469-4ea0-85ce-b6ef270d375a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.342009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.359062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711b8bd-dd2a-4d73-bae3-98d3f76333cd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.359227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.360031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.360371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.360713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.361553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.363010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.378900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.395215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 464/938] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:19.410657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.411795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.412303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.412950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.414126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:19.414766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.416919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.444165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 475/939] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:19.445994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.561565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b18d-a14f-4e9f-83dc-26ef7ad12023 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.597345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.598060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.598340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.598610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.609837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.611333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:19.628995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:19.629910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:19.630764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:19.630764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:19.630764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:19.630764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:19.634894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 465/940] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:19.636625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.745806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d83b-083f-40e7-8812-330470bc760b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.782815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.783512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.783792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.784064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.784804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:19.785112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.786499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efed29-6e24-4126-b265-56a653d34d23 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.800110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 476/941] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:19.800660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.805224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:19.862578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:19.912294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4cb8-8999-497d-a80e-0d07900a7c4d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:19.944039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239d28-63f0-4edd-b75b-fb9239370ecf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.944378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239d28-63f0-4edd-b75b-fb9239370ecf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.944600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239d28-63f0-4edd-b75b-fb9239370ecf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.946228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 477/942] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:19.948458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:19.949485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.949970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.950340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.951523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:19.951971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:19.952390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:19.958741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:19.960344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:19.969868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:19.971272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:19.975337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:19.976381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:19.977450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:19.979265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 466/943] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:19.987752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.051094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 478/944] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:20.070192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.099828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361b62-8740-4b71-97ee-24c70fba5ba4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.113934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:20.136793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.137470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.137928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.138203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.139024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:20.139333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.140797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.155483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 467/945] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:20.166809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.183514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64783d2e-7b13-4adb-996d-faed8637f8c2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.223327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:20.231953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.233106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.233577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.234544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.235703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.237305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.240031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING keystone.server.flask.common [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 19:18:20.263699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:18:20.263699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 19:18:20.263699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [parameters: {'id': '2dd3c18c015f4bc6b3def4dabf216f8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 19:18:20.263699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:18:20.271874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249d8f-959f-4186-aab5-239b7e454569 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2dd3c18c015f4bc6b3def4dabf216f8e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2dd3c18c015f4bc6b3def4dabf216f8e. Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:18:20.275512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 19:18:20.276318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 15 19:18:20.277225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:18:20.278120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:18:20.279032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:18:20.281803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'id': '2dd3c18c015f4bc6b3def4dabf216f8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.283957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:20.286206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2dd3c18c015f4bc6b3def4dabf216f8e. Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 479/946] 10.222.0.57 () {60 vars in 1140 bytes} [Fri Jul 15 19:18:20 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:20.288527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.326629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.327971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.328445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.328931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/fdd35b9fb29349c7a22af2380310e6fe/roles/0308233c99c1480395750f4a7eac43c6` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.332753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=fdd35b9fb29349c7a22af2380310e6fe, role_id=0308233c99c1480395750f4a7eac43c6)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.335194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.354827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 468/947] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:20 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/fdd35b9fb29349c7a22af2380310e6fe/roles/0308233c99c1480395750f4a7eac43c6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:18:20.409250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dfdcc-2b3e-4140-84b4-7065393f326c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.458185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.459543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.460044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.460554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.469454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.471678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6a1bf48b-bb09-4144-8027-51fdeebc3005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:20.488074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:20.489116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:20.490059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:20.492820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 480/948] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:20.499653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.534261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:20.616971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ec47-46f5-46b6-a537-0723f084a27f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.639903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0331-2f87-4dbb-a5c1-dbc2a2f0e5bf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.640198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0331-2f87-4dbb-a5c1-dbc2a2f0e5bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.640474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0331-2f87-4dbb-a5c1-dbc2a2f0e5bf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.645107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 481/949] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:20.652423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.652714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.653332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.657881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.658557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.658872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.659147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.659956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:20.660980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.661639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.672583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:20.674183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:20.682961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 469/950] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:20.729539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:20.759983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 482/951] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:20.784486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:20.887316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:20.898038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efb70-8924-445d-ae63-be47a010b260 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:20.933371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:20.934232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:20.934584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:20.934959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:20.935714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:20.937146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:20.949557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:20.950842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:20.951884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:20.954529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 470/952] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:20.959912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:21.065127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9872d0-b93f-4f06-ac23-dbbb874aac5f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:21.101186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:21.101867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.102153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.102434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.103190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:21.103501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:21.105069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:21.110651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 483/953] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:21.116558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:21.227915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9274-4a1f-4086-a1a9-93aa0ef92631 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:21.263514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:21.264197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.264480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.264755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.265473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:21.265783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:21.267315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1602d50-c7d6-441a-b33c-ec1400b94daa None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:21.272745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 471/954] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:21.278674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:21.322726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:21.386306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44720-cf53-4986-91a1-a26535f66f3c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:21.422152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:21.422846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.423135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.423413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.424158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:21.425544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0dabf-0441-44c8-8781-906926cca12f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:21.447344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 484/955] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:21.547303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2d6c-bc80-4de4-a9d9-288d5457c7bb None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.547502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2d6c-bc80-4de4-a9d9-288d5457c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.547760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2d6c-bc80-4de4-a9d9-288d5457c7bb None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.549500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 472/956] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:21.555312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.555600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.555881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.574147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:21.575424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:21.657883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 485/957] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:21.682054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2d6c-bc80-4de4-a9d9-288d5457c7bb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:21.705707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:21.791314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2d6c-bc80-4de4-a9d9-288d5457c7bb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:21.826053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:21.826828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:21.827125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:21.827399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:21.828051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:21.829424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:21.842140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:21.843315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:21.844186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 473/958] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:21.853771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:21.877819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:21.965016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c53c71-fd44-40b2-83d7-47c8a3d75a37 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:22.002519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:22.003155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.003435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.003707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.004418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:22.004720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:22.006097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1a3c-3d25-4391-83d9-a25bcde4a0a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:22.011523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 486/959] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:22.017438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:22.114531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:22.131043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34d4-b53c-4baf-8549-8e1437c862b0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:22.166600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:22.167336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.167622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.167898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.168603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:22.168914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:22.170290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fadf2f-252a-45c6-af99-0fd02ccff52a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:22.175225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 474/960] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:22.431926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec433-9937-4bc4-87c6-69ce60396805 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.432489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec433-9937-4bc4-87c6-69ce60396805 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.432595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec433-9937-4bc4-87c6-69ce60396805 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.434152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 487/961] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:22.439693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.439983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.440258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.458183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:22.459595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:22.529830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 475/962] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:22.552570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec433-9937-4bc4-87c6-69ce60396805 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:22.643823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:22.665480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec433-9937-4bc4-87c6-69ce60396805 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:22.703644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:22.705339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.706066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.706757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.719330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f0aa7e03-7dca-41d2-a58d-f4b3302d8aee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:22.728412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:22.729664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:22.730732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:22.737894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 488/963] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:22.739489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:22.830841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:22.851713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f14c64-fb46-42c8-9b50-fa0b9451ba94 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:22.886816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:22.887512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.887796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.888068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.888824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:22.889133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:22.890521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:22.899400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 476/964] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:22.904608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026824-d4b3-42a6-a118-acfabaffcea0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.904896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026824-d4b3-42a6-a118-acfabaffcea0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.905180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026824-d4b3-42a6-a118-acfabaffcea0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.905869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:22.906804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 489/965] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:22.911345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:22.911626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:22.911904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:22.934351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:22.936748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:23.020480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa89de-14ed-4002-ab14-47a801528df5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.031247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 490/966] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:23.050617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.058252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.059828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.060254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.060705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.073065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.076686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.079260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:23.102991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:23.104232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:23.105322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:23.105322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:23.105322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:23.105322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:23.107849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 477/967] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:23.114913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.140175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.167182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941e38c-7f24-45fe-a29d-45c425b8e648 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.205339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.206175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.206575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.206974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.207774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.209334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.225145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:18:23.225145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 19:18:23.225145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [parameters: {'user_id': 'e612896efb5b42168e49e1eca725b286', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 19:18:23.225145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:18:23.234046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:18:23.235074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:18:23.236064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:18:23.237366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:18:23.238272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:18:23.239172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e612896efb5b42168e49e1eca725b286', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:23.240187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 19:18:23.242376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 491/968] 10.222.0.57 () {60 vars in 1131 bytes} [Fri Jul 15 19:18:23 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:23.244738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.249729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc885858-1271-4c70-84f5-1c491f6ec977 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.285331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.286426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.287128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.287615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.288579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:23.289086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.290674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.305170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 478/969] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:23.311088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.367955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b04063-75b8-4e3d-8459-df1bdbf13f97 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.380633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.410974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.412040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.412813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.413258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.423238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.425528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.428208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.441599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7632-0b5b-400c-9738-63e1599259be None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:23.446477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:23.448064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:18:23.449175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:23.451804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 492/970] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:23.458217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.489584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.490804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.491096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.491374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.502166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.503663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:23.523427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:23.524399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:23.525340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 479/971] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:23.535972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.591631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae813-a6c1-46b7-8544-11651a0edbff None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.634804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.635560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.635926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.636531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.637795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:23.638103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.639946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07424-e984-4381-9cd4-106c6fdd23d9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.662162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee03c-24af-4b41-aaa4-c7135f72e841 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.675976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.686810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 493/972] 10.222.0.57 () {56 vars in 1101 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:23.686810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6073-df39-4dbe-97ab-2b97849d7a68 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.686810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6073-df39-4dbe-97ab-2b97849d7a68 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.686810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6073-df39-4dbe-97ab-2b97849d7a68 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.686810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 494/973] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:23.688141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.688431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.688711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.708322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:23.708652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.709260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.709539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.709871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.709979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:23.710746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:23.711115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:23.712581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:23.734845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 480/974] 10.222.0.57 () {56 vars in 1149 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:23.741636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.772139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:23.814832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 495/975] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:23.836725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:23.881319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1c46-36de-4376-bd47-53277103fb4f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.923771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:23.924429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:23.924713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:23.924983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:23.956226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28b3f-43c6-4899-be4c-e710a9180632 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:23.971184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.003999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.004836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.005124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.005391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.005491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.006051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.008115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.008221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:24.023048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:24.024274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:24.025196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 496/976] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:24.030926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.087342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.119267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 481/977] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:18:24.125010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.136068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2114-1dbf-4f71-b4ce-b6be9aabecc5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.171590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.172302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.172586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.172865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.173581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:24.173891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.175329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.180348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 497/978] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:24.185834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.198258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.230026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82f89-0604-4c21-8e59-f4da7086dfbc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.262662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.263499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.263781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.264055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.274086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.275566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.285983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b3756-7eb8-45f3-b315-bba3047fa14e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-8d814df5-dbf6-47e6-9a23-0be6ae576abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:24.293793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:24.294644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:24.295561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:24.295561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:24.295561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:24.295561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:24.295561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 482/979] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:24.297362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac684e-6969-4cfa-88e0-ac551f993269 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.297626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac684e-6969-4cfa-88e0-ac551f993269 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.297939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac684e-6969-4cfa-88e0-ac551f993269 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.299514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 483/980] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:24.300838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.303702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac684e-6969-4cfa-88e0-ac551f993269 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.322285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.323020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.323302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.323573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.324282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:24.324588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.325959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba492-8b08-484c-82d7-45991d8d35af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.331425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 498/981] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:24.332649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.332937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.333212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.349866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:24.351031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:24.406312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac684e-6969-4cfa-88e0-ac551f993269 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.416615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 499/982] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:24.417427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.432976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.445443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.446122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.446405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.446680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.447437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:24.447784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.449162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.461058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 484/983] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:24.461889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.538583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1d8f-be5b-4e85-a77c-3762a1a9c861 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.547737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.566041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0001-76ad-407f-b1fa-0feeadce3a30 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.572960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.573627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.573908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.574179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.575011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] RBAC: Adding query filter params (interface=admin, service_id=83ac7d5583ff422cb5eb3aea75e3ca2a, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:24.575325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.576698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.582113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 500/984] 10.222.0.57 () {56 vars in 1249 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/endpoints?service_id=83ac7d5583ff422cb5eb3aea75e3ca2a&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:24.582911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.604892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.605495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.605774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.606054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.606764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.608178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.623221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 485/985] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:24 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:24.624016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.675864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.692203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a663c-2886-434e-be46-68276a54bc17 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.739201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.740028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.740308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.740582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.745964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b776d-c442-4821-a432-45dccd081ddc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.749602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.751170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:24.769025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:24.770009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 501/986] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:24.777131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:24.798061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.798965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.799148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.799859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.800979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.801557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.814756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 486/987] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:18:24.819407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:24.901125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3dfb-536a-4e52-8da9-05a7c837a549 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:24.939051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:24.939732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:24.940011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:24.940278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:24.941082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:24.941388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:24.942898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9dfb-cf63-47ca-a6eb-8992ae1ac10b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:24.957324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 502/988] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:24.963287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:25.066095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b488b1-817f-4b9e-9568-0b14e7964edc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:25.073232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:25.102080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:25.102874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:25.103229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:25.103574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:25.104502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] RBAC: Adding query filter params (role.id=0308233c99c1480395750f4a7eac43c6, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=fdd35b9fb29349c7a22af2380310e6fe) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:25.104888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:25.106407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf752-56b6-49c9-bbf9-817401d6b145 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:25.118882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 487/989] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:24 2022] GET /identity/v3/role_assignments?user.id=fdd35b9fb29349c7a22af2380310e6fe&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=0308233c99c1480395750f4a7eac43c6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:26.665889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d865cd-9e6c-4297-b648-c7316ae0917c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:26.666502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d865cd-9e6c-4297-b648-c7316ae0917c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:26.666502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d865cd-9e6c-4297-b648-c7316ae0917c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:26.667900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 503/990] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:26.673511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679439-066f-47a2-925b-34f7951afece None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:26.673946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679439-066f-47a2-925b-34f7951afece None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:26.674024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679439-066f-47a2-925b-34f7951afece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:26.691342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d5679439-066f-47a2-925b-34f7951afece None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:26.692543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d5679439-066f-47a2-925b-34f7951afece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:26.763915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 488/991] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:26.786078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d865cd-9e6c-4297-b648-c7316ae0917c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:26.810487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa13c2-e045-4264-a32a-71e3e0fcd5a1 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:26.810814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa13c2-e045-4264-a32a-71e3e0fcd5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:26.811129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa13c2-e045-4264-a32a-71e3e0fcd5a1 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:26.812481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 489/992] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:26.817557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:26.817978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:26.818177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:26.837657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:26.839037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:26.887364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:26.901468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d865cd-9e6c-4297-b648-c7316ae0917c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:26.909011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 490/993] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:26.931413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:26.936578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:26.937395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:26.937677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:26.937951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:26.938605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:26.940016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:26.951933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:26.952902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:26.953752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 504/994] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:26.959475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:26.964765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.039603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a87a1f-aa83-4d69-bab9-1a02ca23b7be None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.069919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39d89-3a65-4b26-9236-dfb0e4b245c5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.074492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.075360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.075668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.075946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.076599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.077984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:27.090570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:27.091667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.092616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 491/995] 10.222.0.57 () {56 vars in 1126 bytes} [Fri Jul 15 19:18:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:27.097863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.111514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.112201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.112475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.112751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.113445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.113749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.115143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.124674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 505/996] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:27.126304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.145357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.191883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.199322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cdcc-51a1-4c8f-9671-06b7cf35a4d1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.229571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a870e4-f09e-4773-8265-b994a2a81e3e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.232129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.232875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.233155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.233425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.234117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.234419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.235826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9321d-8895-4065-a52a-3177d6aa56ae None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.240442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 492/997] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:27.241623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acfc5-7d7c-4896-b961-b6768e4d6435 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.241897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acfc5-7d7c-4896-b961-b6768e4d6435 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.242170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acfc5-7d7c-4896-b961-b6768e4d6435 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.243568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 493/998] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:27.248356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8acfc5-7d7c-4896-b961-b6768e4d6435 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.268007 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.268685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.268967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.269276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.269995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.270302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.271710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9e8be-acc0-496e-85b9-8ef216b71859 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.276861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 506/999] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:27.277987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.278276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.278551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.294269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:27.295491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:27.349343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8acfc5-7d7c-4896-b961-b6768e4d6435 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.362303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 507/1000] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:27.363140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.373975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.385317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.386056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.386345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.386624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.387377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.387689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.389107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.394181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 494/1001] 10.222.0.57 () {56 vars in 1122 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:27.394969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.420457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.461362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41439b-668d-4bc7-9485-aa3d6c132c42 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.495416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.495822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb20-e5ac-47f7-9302-a1870c86b141 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.496083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.496360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.496627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.497447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] RBAC: Adding query filter params (interface=public, service_id=311a8276326f4beaa4fd4f228963aa6b, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.497753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.499159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.504313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 508/1002] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/endpoints?service_id=311a8276326f4beaa4fd4f228963aa6b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:27.505068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.536758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.537584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.538035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.538536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] PATH_INFO: `/v3/services/image` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.539231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.540606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:27.554070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:27.555117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:27.555949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 495/1003] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:27.556731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.588335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.614670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75c50-ab1e-48d9-aa3d-b19518755b9a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.640837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.648343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.649083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.649434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.649779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.650534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.651958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.655224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ba3f-7073-4e35-84e6-f7130fabd536 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.667380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 509/1004] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:27.668189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.712800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.713894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.714177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.714452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.715194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.716680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.724128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 496/1005] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:18:27.812136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1f52-dbbd-402c-b214-21c5fe320b57 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:27.855829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:27.856542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:27.856819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:27.857089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:27.857812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:27.858134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:27.859623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be44a0-e858-4eed-a7b8-99b1212437c4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:27.861255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:27.866941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 510/1006] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:27.873537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:27.983040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535cce-7212-4b60-9272-d46d66befc66 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:28.018137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:28.018822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:28.019125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:28.019400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:28.020107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] RBAC: Adding query filter params (type=image) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:28.020414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:28.021797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4d04a-33b9-4966-8438-53770812f9bb None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:28.026716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 497/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:29.687135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa177-c819-4792-9360-462da52dd725 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:29.687730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa177-c819-4792-9360-462da52dd725 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:29.687730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa177-c819-4792-9360-462da52dd725 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:29.689244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 511/1008] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:29.694568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:29.695045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:29.695152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:29.712754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:29.714000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:29.716980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:29.731955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2054-3580-4406-a533-f4c96e442904 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:29.732244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2054-3580-4406-a533-f4c96e442904 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:29.732528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2054-3580-4406-a533-f4c96e442904 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:29.733931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 512/1009] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:29.738750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:29.739130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:29.739487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:29.756444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:29.757626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:29.795038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 498/1010] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:29.817068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:29.831337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 513/1011] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:29.853234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:29.922250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6a792-4ed3-4d02-910e-e7cc330d5d81 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:29.956573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:29.957299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:29.957577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:29.957856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:29.959053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:29.960486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:29.962276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 499/1012] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:29.964457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b175e-777c-4265-a1b2-d18abc3ba154 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:29.967707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:29.978163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:29.995831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:30.004403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.005225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.005506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.005776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.006430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.007841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3e64138b-5e0c-4b9b-9a54-0b0549901a78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:30.019755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:30.020723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:30.021547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 514/1013] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:30.022332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c91fa-68b3-4508-8202-a96eb02c4c52 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.022976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c91fa-68b3-4508-8202-a96eb02c4c52 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.022976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c91fa-68b3-4508-8202-a96eb02c4c52 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.024324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 515/1014] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:30.029639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.029927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.030205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.047568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:30.048794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:30.068559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cd62a-cf7f-4f03-af8f-a4480e4ddc7d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:30.102375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.103049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.103325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.103639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.104334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.105755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.116197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 516/1015] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:30.117015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:30.131720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 500/1016] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:29 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:18:30.148261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:30.216113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:30.251094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92e75f-71f8-4d2a-a76c-272526469618 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:30.261996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1fc63-6c4b-4442-a910-99b8d6bcad37 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:30.279184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:30.295121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.296553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.296839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.297115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.297836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:30.298143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.299567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.300997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.301677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.301958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.302812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.303044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.304408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.304838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 517/1017] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:30.311486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:30.325229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 501/1018] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:30 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:18:30.426041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798efced-6ff0-4b1a-984c-161c9181e665 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:30.472879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.473474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.473736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.474039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.474773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:30.475093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.476492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf6d5-d11e-4fbc-bdd9-32e4d206b733 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.488915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 518/1019] 10.222.0.57 () {56 vars in 1112 bytes} [Fri Jul 15 19:18:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:30.490499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:30.598753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a708b-ed77-4b1f-bc23-5fe90ff0772c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:30.619580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:30.635461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:30.636146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:30.636424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:30.636700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:30.637442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:30.638827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245546-2a4b-4540-bc77-3a5744179305 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:30.658638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 502/1020] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:18:32.199162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed01c-66f9-4ff6-bde0-65049b2e3be0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.199709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed01c-66f9-4ff6-bde0-65049b2e3be0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.199709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed01c-66f9-4ff6-bde0-65049b2e3be0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.201307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 519/1021] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:32.206859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.207278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.207420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.224960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:32.226165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:32.306827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 503/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:32.324606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bb42-2084-4209-b69f-e286cdfdd251 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.324894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bb42-2084-4209-b69f-e286cdfdd251 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.325168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bb42-2084-4209-b69f-e286cdfdd251 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.326570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 520/1023] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:32.331256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.331729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.332016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.332292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.348720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:32.349900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:32.394352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:32.421549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 521/1024] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:32.443039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.444045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122387d-cb80-4326-9fe6-60eecf111c53 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:32.445760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:32.482273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:32.483826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.484109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.484384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.485647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:32.487125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:32.489051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 504/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:32.494655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.559454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53952016-78c4-44d6-8240-07581e8f59d9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:32.599780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:32.600594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.600879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.601178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] PATH_INFO: `/v3/services/image` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.601816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:32.603233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:32.607343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd97-0eb1-422d-8722-3dbee246e944 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:32.615287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:32.616524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:32.617360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 522/1026] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:32.623428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.647813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:32.648496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.648781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.649058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.649767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:32.651295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea2263-3fa3-4745-a63f-c0b5716c7174 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:32.666748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:32.675730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 505/1027] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:18:32 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:18:32.730230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ff89-603e-4e9e-a65b-d7d6e5776dc4 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.730529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ff89-603e-4e9e-a65b-d7d6e5776dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.730766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ff89-603e-4e9e-a65b-d7d6e5776dc4 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.732527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 506/1028] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:32.738220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.738598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.738760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.752686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4055e9-9e27-43c5-b16e-7fa89aa63e25 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:32.757308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:32.758557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:32.785314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:32.803005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:32.803710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.804057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.804333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.805118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:32.805428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:32.807055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:32.818833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 523/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:32.821219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.850901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 507/1030] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:32.874027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.936821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57d74-afc5-4025-b5e3-2e45310b616e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:32.940459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:32.975898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:32.976575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:32.976851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:32.977122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:32.977928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:32.978234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:32.979841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:32.985317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 524/1031] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:32.991681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:32.992880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7679-489e-42f0-a4a9-5bd94d312bba None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.030295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.031159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.031445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.032327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.043791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:33.051961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:33.053202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:33.054036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 508/1032] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:33.059359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.081340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:33.104538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625161d8-fff3-4df4-834d-569969c1d10d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.139879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.140550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.140834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.141107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.142127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] RBAC: Adding query filter params (interface=public, service_id=4d8c6868c0f04d0fa34627e65aa84e24, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:33.142232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.143647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.153563 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 525/1033] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:18:32 2022] GET /identity/v3/endpoints?service_id=4d8c6868c0f04d0fa34627e65aa84e24&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:33.154623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.168659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f570-d2d7-4dd3-969a-7b88dd71a913 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.187651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:33.205692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.206502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.206735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.207017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.207718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:33.208023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.209402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.218029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 509/1034] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:33.223693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.268588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3a4d7-79a6-4dee-b19c-fea412e955cd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.312653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:33.315280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.316183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.316867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.317145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.318388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.319942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.338824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 526/1035] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:18:33.339038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4632-b163-46e2-9cba-6df2da38faf2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.376235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.377059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.377344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.377621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.390259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.391782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:33.410909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:33.411857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:33.412720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:33.412720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:33.412720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:33.412720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:33.412720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 510/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:33.418255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.525949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:33.532553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5526-a02c-4da0-a6ec-441b35be8aa7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.566924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.567931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.568409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.568895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.569828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:33.570324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.571903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.584590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 527/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:33.590415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.694598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887584e-ff85-47d5-bdda-4571f897d03e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.723201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:33.729993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.730812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.731104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.731368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] PATH_INFO: `/v3/users/nova` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.739116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.740552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:33.754353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:33.755296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:33.756223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:33.758854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 511/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:33.761817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:33.873905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09276323-956c-4e6d-81ca-45dbbe7afac4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:33.910321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:33.911031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:33.911317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:33.911593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:33.912436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:33.912754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:33.914193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:33.931769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 528/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:33.937445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.044097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756dec-da9c-46d0-8a91-e6e611449ade None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:34.077799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:34.078380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.078658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.078966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.136070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.147444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:34.148895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:34.244554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 512/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:34.250355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.266818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.356865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e052-5ca5-4d57-bbaa-314219e69b75 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:34.393291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:34.394468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.394998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.395492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.406483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:34.408228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:34.426159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:34.427128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:34.428027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:34.428027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:34.428027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:34.428027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:34.428728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 529/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:34.434503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.530811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.541926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8868e6-9092-43b9-950c-47450b59d303 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:34.575011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:34.575680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.575954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.576221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.576933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:34.577235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:34.578603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0e37-f15c-4728-941f-ec821d2c6496 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:34.590315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 513/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:34.595950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.663133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.703613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5579f-3938-47f8-996b-31532d532f3f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:34.738342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:34.739449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.739902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.740347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.747393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:34.748998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:34.763837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3387d7-73ac-4e6a-af93-bf0b4474cd7d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.764124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3387d7-73ac-4e6a-af93-bf0b4474cd7d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:34.764253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:34.765056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:34.765942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:34.766364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3387d7-73ac-4e6a-af93-bf0b4474cd7d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.766436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 530/1043] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:34.770441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 514/1044] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:34.771673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.776021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.776303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.776580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.793591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:34.794815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:34.870280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 515/1045] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:34.887838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-04d6-49b2-9ff4-a30c425e3f3a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:34.893510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.917633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.927788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:34.928577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:34.928975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:34.929252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:34.930046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:34.930357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:34.931889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:34.944679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 531/1046] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:34.950515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:34.976214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:34.997053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17b13-6461-4cd3-8b01-8d08ca057abe None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.042054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.043277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.043739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.044197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.055537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:35.063538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:35.064534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:35.067816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:35.068602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd2e3-acf0-41a6-90ff-3194b9cee4bf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.068692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 516/1047] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:35.070628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.106740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.107425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.107703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.107970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.108792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] RBAC: Adding query filter params (role.id=0308233c99c1480395750f4a7eac43c6, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:35.109098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.110522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.126816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 532/1048] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:34 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=0308233c99c1480395750f4a7eac43c6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:35.181500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cd13-0a1c-43a2-95ae-8ef61fdbf533 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.219072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.219967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.220248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.220515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.221266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:35.221566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.222978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a74f6-b5b0-4d34-8dd2-6b6065690528 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.232525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 517/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:35.238745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.296579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.349224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e221-6275-40e1-9301-caef9becdae2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.379396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1217d0-82c9-4a4b-b30b-ede33a0d00ca None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.380179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1217d0-82c9-4a4b-b30b-ede33a0d00ca None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.380179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1217d0-82c9-4a4b-b30b-ede33a0d00ca None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.381311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 518/1050] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:35.386659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.386984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.387266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.392444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.392910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.394092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.394400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.394681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] PATH_INFO: `/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.406834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:35.407929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:35.409398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] RBAC: Authorizing `identity:get_user(user_id=4a98edda3f9f4b989ee4e0f9bef33a52)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.410989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.412704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 533/1051] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:35.418476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.482658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 519/1052] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:35.504754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.528274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd7c5-90c1-4ddd-8bb0-db0563825413 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.538472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.566834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.566834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.566834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.567230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.608525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253d07-9499-4431-9b3a-3dff8c3b80bb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.637040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.640977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.642661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.642876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.643616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.643926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.644199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] PATH_INFO: `/v3/services/image` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.644855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.646210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:35.657985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:35.659076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:35.660248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 520/1053] 10.222.0.57 () {56 vars in 1105 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:35.665165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.749799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 534/1054] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:18:35.755561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.765575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.771283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb41c-e956-4236-9d5a-e969e1a5d33d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.816136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.816848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.817130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.817404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.818115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:35.818424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.819847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.825482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 521/1055] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:35.831440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.868714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54959-35da-4491-82b0-ba9d44f899bc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.897278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:35.906889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.907828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.908057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.908333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.909520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.910998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.912918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 535/1056] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:35.919161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:35.941064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1be33-f84b-45a2-8a1c-6841582db3a1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:35.974984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:35.975700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:35.975996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:35.976256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:35.976965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] RBAC: Adding query filter params (type=image) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:35.977274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:35.978702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:35.988259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 522/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:35.989238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:36.004102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:36.028827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814b0fb-55c6-4bf1-be1f-e40b2cbfdd85 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:36.063107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:36.063763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:36.064039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:36.064304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:36.065120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=bcb431f83a6a4b5dbea040d62e320d61, user.id=4a98edda3f9f4b989ee4e0f9bef33a52) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:36.065425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:36.066890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30543db-bed1-471f-a1e8-75d0f9c6ecdc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:36.082825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 536/1058] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:35 2022] GET /identity/v3/role_assignments?user.id=4a98edda3f9f4b989ee4e0f9bef33a52&scope.project.id=bcb431f83a6a4b5dbea040d62e320d61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:36.106914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ddc14-f222-4faa-b11d-762dcce52933 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:36.133968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:36.147133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:36.147809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:36.148087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:36.148359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:36.149121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:36.150551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3284cf-90be-45fe-988b-351b0d0b2e92 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:36.173652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 523/1059] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:18:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:37.122112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326cf-b27f-4cd6-ad37-b3ccf3360b61 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.122614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326cf-b27f-4cd6-ad37-b3ccf3360b61 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.122614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326cf-b27f-4cd6-ad37-b3ccf3360b61 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.124015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 537/1060] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:37.129340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.129827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.129907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.146938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:37.148125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:37.227386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 524/1061] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:37.249324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0326cf-b27f-4cd6-ad37-b3ccf3360b61 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:37.357327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0326cf-b27f-4cd6-ad37-b3ccf3360b61 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:37.392163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:37.393001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.393271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.393540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.401894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:37.405547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:37.414082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:37.415054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:37.419470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 538/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:37.423353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:37.525593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f919-afa3-47e0-b348-70ec83cd2a00 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:37.532854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:37.562868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:37.563558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.563836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.564104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.564847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:37.565150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:37.566514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:37.579772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 525/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:37.581432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:37.687087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd06f-9297-4afe-b376-66ce9d6dacbd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:37.721432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:37.722237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.722514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.722816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.733617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:37.735097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:37.752088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:37.753002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:37.753887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:37.753887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:37.753887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:37.753887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:37.755116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 539/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:37.759193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:37.867965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f38d65-3c0c-46e0-87e4-f1f89df9d978 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:37.901941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737609b6-765a-4310-9893-93472805166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:37.902608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737609b6-765a-4310-9893-93472805166c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:37.902911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737609b6-765a-4310-9893-93472805166c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:37.903182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737609b6-765a-4310-9893-93472805166c None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:37.903898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737609b6-765a-4310-9893-93472805166c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:37.904198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737609b6-765a-4310-9893-93472805166c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:37.905552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737609b6-765a-4310-9893-93472805166c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:37.917596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 526/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:37.923291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:37.975878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.024760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43313eb-7296-4479-9e6c-8c10b3658b03 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.059334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.060149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.060417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.060686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.068546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.070002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.083332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577907bf-e1c8-44ff-80f6-47f9880369ba None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.083627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577907bf-e1c8-44ff-80f6-47f9880369ba None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.083901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577907bf-e1c8-44ff-80f6-47f9880369ba None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:38.084390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:38.085266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:38.086188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:38.086735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 527/1066] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:38.089323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 540/1067] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:18:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:38.090820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372bd9c-372b-42fd-9673-15113002ec1b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.091112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372bd9c-372b-42fd-9673-15113002ec1b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.091394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372bd9c-372b-42fd-9673-15113002ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.091648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.107969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b372bd9c-372b-42fd-9673-15113002ec1b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:38.109169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b372bd9c-372b-42fd-9673-15113002ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:38.132382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.180446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 528/1068] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:38.189309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1cc19-0fea-49ca-b85e-500440335070 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.189599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1cc19-0fea-49ca-b85e-500440335070 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.189878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1cc19-0fea-49ca-b85e-500440335070 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.191290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 529/1069] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:38.196859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.197395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.197700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.202240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ea2e-710a-481e-b601-6b2e3482c77b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.214736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:38.215561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.215966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:38.237173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.237785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.238069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.238347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.239221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:38.239541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.240981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.257899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 541/1070] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:38.263091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.282881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 530/1071] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:38.283728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.361325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc5156-ed9d-4ecc-b4cc-0c2ea4ddb811 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.374249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.386250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61209-98c8-4326-8a50-68aa106fb1b3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.394867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.395672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.395947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.396212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.405994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:38.413636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:38.414628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:38.415489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 542/1072] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:38.416283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.424217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.425120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.425403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.425673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.436310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.437762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.445449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:38.456805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:38.457727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:38.458607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:38.458607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:38.458607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:38.458607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:38.458607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 531/1073] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:38.458934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.520950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794adf-25d4-40e9-8ddf-d46ff4518d57 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.555147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d2f4-4d68-412a-87af-a23fb6f50193 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.555305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.555887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.556167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.556493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.589658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.590318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.590596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.590896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.591635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:38.591934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.593305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.601461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 532/1074] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:38.602242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.604831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.627016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.628755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.657226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.700652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f5ad3-bb3a-44d8-bbf5-fa9911fb7561 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.728375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 543/1075] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:38.729217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.735451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.736123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.736407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.736684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.737407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:38.737750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.739150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.750808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 533/1076] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:38.751583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.814270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.831571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ad971-95f7-435d-8815-3bf3672d03f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.853424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22348f64-fff0-4211-85f1-702939b4a9cc None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:38.859651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:38.866173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.867091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.867372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.867643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] PATH_INFO: `/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.868866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] RBAC: Authorizing `identity:get_user(user_id=4a98edda3f9f4b989ee4e0f9bef33a52)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.870317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.871994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 544/1077] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:38.872753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.894021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:38.894860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:38.895136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:38.895407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:38.905574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:38.907169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:38.924923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:38.925823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:38.926725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:38.926725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:38.926725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:38.926725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:38.926725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 534/1078] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:38.927473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:38.978734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8930785-343e-4b96-8e23-a296dbd0cb37 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.013607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.014411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.014694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.014999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.022071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.023408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.027582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2c36-a17c-402a-a614-32fb67d96b5f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:39.037399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:39.038284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 545/1079] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:39.039415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:39.044579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:39.065204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.065947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.066224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.066491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.067752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.069182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.074995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 535/1080] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:38 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:39.074995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:39.100716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:39.142715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abb31-789a-4b4a-aff8-07e8c93fae57 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.169949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d38fe2-3cb0-4aa4-a97d-1f098e975264 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.176805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.177473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.177752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.178011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.178872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:39.179183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.180562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.206809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 546/1081] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:39.206809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:39.207738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.207738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.207738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.208099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.218817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:39.218817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.218817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.225971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 536/1082] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:39.232365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:39.277840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:39.319936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6a08-8932-4d11-9f13-e82adf180015 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.342447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:39.342663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41dab-893e-4dad-9786-c3196e078c4d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:39.364234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.365164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.365443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.365755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61/users/4a98edda3f9f4b989ee4e0f9bef33a52/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.368330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb431f83a6a4b5dbea040d62e320d61, user_id=4a98edda3f9f4b989ee4e0f9bef33a52, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.370505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652da2-eb4d-49aa-b9dd-7516886cc504 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.383287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:39.384820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:39.385098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:39.385365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/0308233c99c1480395750f4a7eac43c6` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:39.391467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 547/1083] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:39 2022] PUT /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61/users/4a98edda3f9f4b989ee4e0f9bef33a52/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:39.391650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=1876435c9cdf4e11a6d193017d53ed49, role_id=0308233c99c1480395750f4a7eac43c6)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:39.391650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209f42a-4cfe-4979-a470-01f78a0647b4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:39.404853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 537/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:39 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/1876435c9cdf4e11a6d193017d53ed49/roles/0308233c99c1480395750f4a7eac43c6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:18:41.374723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff024d-e839-4ff9-a108-2befd01d2215 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.375361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff024d-e839-4ff9-a108-2befd01d2215 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.375361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff024d-e839-4ff9-a108-2befd01d2215 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.376712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 548/1085] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:41.382123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.382504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.382659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.400397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:41.401589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:41.410498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea47d3-d8ab-4e12-a816-fc0cb77a042b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.410803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea47d3-d8ab-4e12-a816-fc0cb77a042b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.411127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea47d3-d8ab-4e12-a816-fc0cb77a042b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.412476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 549/1086] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:18:41.417480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.417842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.418190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.435428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:41.436634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:41.470371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 538/1087] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:41.497368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.511679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 550/1088] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:41.528806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:41.535503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.597851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ec81-2223-44fb-bed2-30e539cb0a14 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.630869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.631673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.631953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.632079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a052d-28a7-4729-80b3-e2b99a5587a2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.632248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.641311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:41.643167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:41.651463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:41.652584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:41.653595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:41.657911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 539/1089] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:41.658971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.668532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.669367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.669633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.669902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.680338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:41.688628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:41.689686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:41.690502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 551/1090] 10.222.0.57 () {56 vars in 1120 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:41.695910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.752935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:41.762462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e57c1-6547-4a1b-9af0-2aedc1622013 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.796815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.797575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.797657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee26fb-be45-4a0b-b0b6-3de6cf586f1d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.797747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.798010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.798756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:41.799081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:41.800470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:41.808738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 540/1091] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:41.814658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.831866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.832571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.832858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.833139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.833892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:41.834200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:41.835621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:41.843622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 552/1092] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:41.849293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.879622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:41.913855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96da2-d447-40fc-93c8-cd401b7f0318 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.947678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.948564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.948846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.949121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] PATH_INFO: `/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.950334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=4a98edda3f9f4b989ee4e0f9bef33a52)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:41.950801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558083-2df0-4fee-a1bb-bced5bb271e5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:41.951809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:41.953459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 541/1093] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/users/4a98edda3f9f4b989ee4e0f9bef33a52 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:41.959626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:41.983004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:41.984400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:41.985608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:41.985924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:41.986204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:41.996780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:41.998295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:42.015356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:42.016290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:42.017162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:42.017162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:42.017162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:42.017162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:42.017162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 553/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:42.022341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.058383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c774e4-5b81-4167-9ad2-732a8943c4a2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.093227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.093866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.094151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.094426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.104028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.123725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfdf1-b672-42ae-8188-3def2b2ca376 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.160185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.160851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.161135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.161408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.162134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:42.162225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.162442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.163708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.163822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.175804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 554/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:42.184041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.186464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.266369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 542/1096] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:18:42.272362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.286053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcf1d-ea75-4acb-9fc8-04203b7a7dd5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.325612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.326416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.326698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.327000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.334463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.336002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:18:42.350331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:42.351345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:18:42.352571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 555/1097] 10.222.0.57 () {56 vars in 1093 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:42.357386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.359980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.372836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b2a6d-f0dd-4a81-9102-3fb1821af9bf None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.395377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.407338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.408227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.408488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.408757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.409932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.411416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.413150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 543/1098] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:42.419183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.457593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384f14-279c-42d5-8698-0a060b4aa6f2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.491233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.491940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.492223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.492499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.493351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:42.493716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.495196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.513996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 556/1099] 10.222.0.57 () {56 vars in 1133 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:42.517954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1ca-4d05-446c-b92d-72cd08b09825 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.519786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.551985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.552644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.552926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.553189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.554027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=bcb431f83a6a4b5dbea040d62e320d61, user.id=4a98edda3f9f4b989ee4e0f9bef33a52) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:42.554324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.555794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.561818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 544/1100] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/role_assignments?user.id=4a98edda3f9f4b989ee4e0f9bef33a52&scope.project.id=bcb431f83a6a4b5dbea040d62e320d61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:42.580334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.626309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f337e-cc57-4de6-9d02-ad234724b293 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.664653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.665320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.665736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.665984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:42.737382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:42.738769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:42.795194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.839111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 557/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:18:42.844899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:42.904192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:42.954731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4520a-be8c-4944-84fb-2c23c3b96178 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:42.989717 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:42.990441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:42.990722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:42.991020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:43.002209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:43.003760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:43.022407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:43.023563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:43.024438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:18:43.024438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:43.024438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:18:43.024438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:43.024438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 545/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:43.029518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:43.137413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f793fc-a4c1-42d5-8eaa-3b0350a00ead None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:43.171935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:43.172606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:43.172891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:43.173169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:43.173900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:43.174210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:43.175622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:43.193276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 558/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:43.193490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:43.293210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0689e-c590-43ee-bec4-7f6ab76a5648 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:43.301385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:43.328460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:43.329629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:43.329916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:43.330189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:43.336809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:43.338335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:18:43.351967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:43.353172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:18:43.354107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 546/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:18:43.359248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:43.382513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:43.465700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4c59f-e76d-454b-a960-41d02f272198 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:43.501982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:43.502656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:43.502974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:43.503226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:43.504016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:43.504332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:43.505790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49c635-3393-4000-88d5-65702a074c89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:43.519061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 559/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:43.525145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:43.627119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24189c-88eb-4a53-9391-2ff43e5088e5 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:43.661504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:43.662160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:43.662445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:43.662718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:43.663571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] RBAC: Adding query filter params (role.id=0308233c99c1480395750f4a7eac43c6, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=1876435c9cdf4e11a6d193017d53ed49) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:43.663882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:43.665322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607788ce-e62a-4a67-b455-14e992caa4cf None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:43.671505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 547/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:43 2022] GET /identity/v3/role_assignments?user.id=1876435c9cdf4e11a6d193017d53ed49&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=0308233c99c1480395750f4a7eac43c6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:18:44.589317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91eeea-96bb-499b-9391-a8410d933011 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:44.590210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91eeea-96bb-499b-9391-a8410d933011 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:44.590210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91eeea-96bb-499b-9391-a8410d933011 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:44.592484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 560/1107] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:44.598901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:44.599333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:44.599491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:44.623938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:44.625127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:44.652787 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:44.712994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 548/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:44.737434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91eeea-96bb-499b-9391-a8410d933011 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:44.823229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:44.846657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91eeea-96bb-499b-9391-a8410d933011 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:44.882593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:44.883428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:44.883715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:44.883991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:44.885275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:44.886701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bda90-a995-4e61-b2bd-c23dcb9dc345 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:44.888400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 561/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:44.898195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:45.012025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390717-3835-49ee-8c4c-a710d35b0a82 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:45.050608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:45.051304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:45.051588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:45.051860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:45.052569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:45.054015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b211cf5-0b98-4659-9218-5ec5d35a3de3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:45.076258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 549/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:18:44 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:47.071086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4973f-b134-47ae-8de6-c8cf6a67d5eb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:47.071614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4973f-b134-47ae-8de6-c8cf6a67d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:47.071614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4973f-b134-47ae-8de6-c8cf6a67d5eb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:47.072942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 562/1111] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:47.079664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:47.080407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:47.080541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:47.100855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:47.102056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:47.112794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:47.179494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 550/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:47.208594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4973f-b134-47ae-8de6-c8cf6a67d5eb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:47.332347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4973f-b134-47ae-8de6-c8cf6a67d5eb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:47.368296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:47.369150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:47.369434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:47.369709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] PATH_INFO: `/v3/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:47.371363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] RBAC: Authorizing `identity:get_role(role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:47.372746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:47.374101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 563/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:47 2022] GET /identity/v3/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:47.383793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:47.487815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c318-02a8-4450-96c4-e77dcb1a6ac2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:47.525626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:47.526742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:47.527060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:47.527333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] PATH_INFO: `/v3/users/b9a7178c362c44278ce8a9f22f830c21` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:47.540930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] RBAC: Authorizing `identity:get_user(user_id=b9a7178c362c44278ce8a9f22f830c21)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:47.542404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:47.544130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 551/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:47 2022] GET /identity/v3/users/b9a7178c362c44278ce8a9f22f830c21 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:47.550975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:47.574930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:47.676359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468dec3-0641-4e4d-a465-2a64f399bb32 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:47.712495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:47.713135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:47.713414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:47.713686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:47.782435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:47.783954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:47.800928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:47.885760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 564/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:47.891935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:47.896236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:47.996820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89057e5e-51af-410b-a168-5bdd9387bea0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:48.031937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:48.032801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:48.033079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:48.033345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:48.034646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:48.036093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421ede-9f5a-4ac2-a37d-db368c996c1c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:48.037786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 552/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:47 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:48.044840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:48.157934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6728-f01e-4da9-8696-d521f948da96 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:48.178463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:48.206096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:48.206754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:48.207068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:48.207345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:48.208173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=bcb431f83a6a4b5dbea040d62e320d61, user.id=b9a7178c362c44278ce8a9f22f830c21) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:48.208485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:48.209955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212deb1-7801-4399-b4d6-9a5794bb3161 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:48.215715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 565/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:48 2022] GET /identity/v3/role_assignments?user.id=b9a7178c362c44278ce8a9f22f830c21&scope.project.id=bcb431f83a6a4b5dbea040d62e320d61&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:50.175767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c4ef-efab-4c9c-9f87-347eda3a2436 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.176633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c4ef-efab-4c9c-9f87-347eda3a2436 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.176633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c4ef-efab-4c9c-9f87-347eda3a2436 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.178945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 553/1118] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:50.184413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.184823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.184963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.206531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:50.207760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:50.286977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 566/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:18:50.309989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864c4ef-efab-4c9c-9f87-347eda3a2436 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:50.390069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:50.421630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864c4ef-efab-4c9c-9f87-347eda3a2436 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:50.457000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:50.457781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.458061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.458325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] PATH_INFO: `/v3/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.459948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] RBAC: Authorizing `identity:get_role(role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:50.461320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:50.462698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 554/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:50 2022] GET /identity/v3/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:50.469022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:50.582298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4ed2-bb3c-4b78-ad6d-3a8ad479fe88 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:50.593691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:50.620051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:50.620934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.621213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.621519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] PATH_INFO: `/v3/users/b9a7178c362c44278ce8a9f22f830c21` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.622683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] RBAC: Authorizing `identity:get_user(user_id=b9a7178c362c44278ce8a9f22f830c21)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:50.624164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:50.625836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 567/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:50 2022] GET /identity/v3/users/b9a7178c362c44278ce8a9f22f830c21 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:50.632464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:50.745528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fa27-013e-4f84-9a21-0ac48f17d2d1 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:50.780101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:50.780965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.781240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.781506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.782814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:50.784249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b7ae3-8ee6-46c1-acf8-434cdcd01ad6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:50.785928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 555/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:50 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:50.792437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:50.894878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84094d-617d-43f5-b303-4fc0202f4ecf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:50.930612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:50.931543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:50.931819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:50.932080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61/users/b9a7178c362c44278ce8a9f22f830c21/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:50.934632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb431f83a6a4b5dbea040d62e320d61, user_id=b9a7178c362c44278ce8a9f22f830c21, role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:50.936099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182209d-de14-48a0-96d3-17d61f743701 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:50.951639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 568/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:50 2022] PUT /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61/users/b9a7178c362c44278ce8a9f22f830c21/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:52.938774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf70c2-4f83-44fc-abfc-51ed8b739d17 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:52.939415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf70c2-4f83-44fc-abfc-51ed8b739d17 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:52.939415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf70c2-4f83-44fc-abfc-51ed8b739d17 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:52.940747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 556/1124] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:52.947215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:52.947926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:52.948096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:52.971642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:52.972835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:53.008464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:53.053552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 569/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:53.077463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf70c2-4f83-44fc-abfc-51ed8b739d17 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:53.093104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:53.191920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf70c2-4f83-44fc-abfc-51ed8b739d17 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:53.226966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:53.227889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:53.228165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:53.228437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] PATH_INFO: `/v3/roles/33ea215e3de14e3cab6c8e3b9962b388` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:53.230045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] RBAC: Authorizing `identity:get_role(role_id=33ea215e3de14e3cab6c8e3b9962b388)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:53.231460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:53.232826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 557/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:53 2022] GET /identity/v3/roles/33ea215e3de14e3cab6c8e3b9962b388 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:53.238974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:53.346344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372fe8c-baf8-4597-9f76-8ff74d9111de None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:53.381371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:53.382236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:53.382511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:53.382816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] PATH_INFO: `/v3/users/b9a7178c362c44278ce8a9f22f830c21` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:53.384207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] RBAC: Authorizing `identity:get_user(user_id=b9a7178c362c44278ce8a9f22f830c21)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:53.385654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:53.387311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 570/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:53 2022] GET /identity/v3/users/b9a7178c362c44278ce8a9f22f830c21 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:53.393828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:53.489028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:53.512703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451fff-a7a2-4aa3-b156-9839c4bbcf6e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:53.548087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:53.548726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:53.549004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:53.549271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:53.620092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:53.621464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:53.697151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:53.723411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 558/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:53.729786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:53.769085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:53.840091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4009-1a3c-4741-87e8-c6ac60bb891a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:53.875470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:53.876270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:53.876553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:53.876826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] PATH_INFO: `/v3/projects/bcb431f83a6a4b5dbea040d62e320d61` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:53.878132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] RBAC: Authorizing `identity:get_project(project_id=bcb431f83a6a4b5dbea040d62e320d61)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:53.879606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ecc69-a039-46b6-adb0-a6fc83bfa46e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:53.881320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 571/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:53 2022] GET /identity/v3/projects/bcb431f83a6a4b5dbea040d62e320d61 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:53.888493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:54.000860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea606e-c8f4-47e9-b727-4142b57596af None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:54.041040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:54.041693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:54.041972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:54.042244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:54.043101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] RBAC: Adding query filter params (role.id=33ea215e3de14e3cab6c8e3b9962b388, scope.project.id=bcb431f83a6a4b5dbea040d62e320d61, user.id=b9a7178c362c44278ce8a9f22f830c21) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:54.043413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:54.044863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385978-385f-46e8-9112-c5557e23d054 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:54.050812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 559/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:53 2022] GET /identity/v3/role_assignments?user.id=b9a7178c362c44278ce8a9f22f830c21&scope.project.id=bcb431f83a6a4b5dbea040d62e320d61&role.id=33ea215e3de14e3cab6c8e3b9962b388 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:56.061423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf30-8d37-445a-b900-59f2692cec93 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:56.061981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf30-8d37-445a-b900-59f2692cec93 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:56.061981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf30-8d37-445a-b900-59f2692cec93 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:56.063322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 572/1131] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:56.069669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:56.070416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:56.070592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:56.095183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:56.096376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:56.132487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:56.177676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 560/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:56.200852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedaf30-8d37-445a-b900-59f2692cec93 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:56.308734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedaf30-8d37-445a-b900-59f2692cec93 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:56.311153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:56.344643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:56.345377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:56.345658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:56.345928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:56.347194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:56.348653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eed92f-1d0a-4251-8a12-d83507a30fd1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:56.350272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 573/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:56.357252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:56.468569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a3450-7bc3-45df-8907-e58be9199d9e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:56.507582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:56.508244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:56.508520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:56.508836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:56.509571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:56.511035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884e3e-e072-4cbe-ae99-92ee8c5b7246 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:56.543359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 561/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:56 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:58.563061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c7499-82c9-4beb-978f-f8fc375ac34f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:58.563643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c7499-82c9-4beb-978f-f8fc375ac34f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:58.563643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c7499-82c9-4beb-978f-f8fc375ac34f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:58.565712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 574/1135] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:58.574284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:58.574691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:58.574923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:58.602771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:58.604004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:58.620804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:58.685745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 562/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:58.715030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c7499-82c9-4beb-978f-f8fc375ac34f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:58.821492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c7499-82c9-4beb-978f-f8fc375ac34f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:58.857368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:58.858171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:58.858451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:58.858723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:58.859966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:58.861416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3c42e-e154-47f8-8789-5bfb75dc23b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:58.863081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 575/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:18:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:58.869546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:58.977749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d21e9-87b3-4cd0-a512-1c343bc40cfb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:59.020193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:59.020863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:59.021149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:59.021426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:59.022149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:59.023630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cc313-868d-4124-bbbe-d824e79da612 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:59.046136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 563/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:18:58 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:19:01.089687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d1c8-64e9-4a46-89b5-a341f9623037 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.090522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d1c8-64e9-4a46-89b5-a341f9623037 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.090522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d1c8-64e9-4a46-89b5-a341f9623037 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.092612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 576/1139] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:01.100436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.100888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.100979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.119815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:01.121007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:01.122979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:01.202638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 564/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:01.231307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d1c8-64e9-4a46-89b5-a341f9623037 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:01.283163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:01.345555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d1c8-64e9-4a46-89b5-a341f9623037 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:01.380858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:01.381654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.381938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.382213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.393290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:01.401055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:01.402259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:01.403519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 577/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:01.408515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:01.513446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f86e9-aaf3-4a41-bfc5-7edb9f81fe6f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:01.548423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:01.549088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.549369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.549642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.550386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:01.550686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:01.552103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:01.557228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:01.560863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 565/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:01.567561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:01.667236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:01.671763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734dac1-2e79-42a0-90ab-ff718294ccaa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:01.717431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:01.718302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.718579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.718892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] PATH_INFO: `/v3/users/2d692125456a4e128d87c49b7b61750b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.732270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] RBAC: Authorizing `identity:get_user(user_id=2d692125456a4e128d87c49b7b61750b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:01.733736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:01.735414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 578/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:01 2022] GET /identity/v3/users/2d692125456a4e128d87c49b7b61750b => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:01.741415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:01.846828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68bcd-f201-48ed-8da3-c09b8bf2937d None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:01.883869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:01.884922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:01.885388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:01.885777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:01.954687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:01.957125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:01.958630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:02.059483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 566/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:02.066332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:02.185172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55dec-4d65-4f55-a40e-f973e030fee9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:02.221580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:02.222381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:02.222666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:02.222972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] PATH_INFO: `/v3/projects/1102a94e50294918b0bd2dc6ae79f753` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:02.224290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=1102a94e50294918b0bd2dc6ae79f753)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:02.225735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283266fa-1a0c-41cd-ad7c-17878e50f6a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:02.227458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 579/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:02 2022] GET /identity/v3/projects/1102a94e50294918b0bd2dc6ae79f753 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:02.233790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:02.338170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:02.341145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffdd11-58c2-46de-86e6-3cf15de96847 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:02.376999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:02.377646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:02.377933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:02.378209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:02.379063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=1102a94e50294918b0bd2dc6ae79f753, user.id=2d692125456a4e128d87c49b7b61750b) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:02.379379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:02.380815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95331-7101-449f-beb2-fb36cdd33e81 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:02.386376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 567/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:02 2022] GET /identity/v3/role_assignments?user.id=2d692125456a4e128d87c49b7b61750b&scope.project.id=1102a94e50294918b0bd2dc6ae79f753&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:04.360453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312b90-1d49-4fe6-9a3f-db6bc74cfafa None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:04.361020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312b90-1d49-4fe6-9a3f-db6bc74cfafa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:04.361020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312b90-1d49-4fe6-9a3f-db6bc74cfafa None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:04.362379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 580/1147] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:04.369153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:04.369889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:04.370041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:04.393324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:04.394525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:04.467043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 568/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:04.494330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312b90-1d49-4fe6-9a3f-db6bc74cfafa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:04.525826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:04.613591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312b90-1d49-4fe6-9a3f-db6bc74cfafa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:04.651786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:04.652655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:04.652932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:04.653201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:04.664598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:04.672253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:04.673281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:04.674129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 581/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:04.679862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:04.781387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:04.790654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472595c-00d3-4eeb-8d19-b294f4391290 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:04.825998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:04.826689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:04.827005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:04.827272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:04.828022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:04.828327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:04.830072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:04.838735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 569/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:04.844876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:04.932837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:04.949219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e383a-4010-40b1-8e39-a2f09c35bc40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:04.985708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:04.986584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:04.986906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:04.987231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] PATH_INFO: `/v3/users/2d692125456a4e128d87c49b7b61750b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:04.988484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] RBAC: Authorizing `identity:get_user(user_id=2d692125456a4e128d87c49b7b61750b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:04.989936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:04.991597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 582/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:04 2022] GET /identity/v3/users/2d692125456a4e128d87c49b7b61750b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:04.998279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:05.111752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf41408-275b-4219-90af-68c63639c54b None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:05.147546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:05.148415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:05.148692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:05.148963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] PATH_INFO: `/v3/projects/1102a94e50294918b0bd2dc6ae79f753` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:05.150260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] RBAC: Authorizing `identity:get_project(project_id=1102a94e50294918b0bd2dc6ae79f753)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:05.151735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e450f68-a362-4d24-96b1-24731906872c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:05.153476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 570/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:04 2022] GET /identity/v3/projects/1102a94e50294918b0bd2dc6ae79f753 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:05.163551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:05.279146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9209d4-0113-4394-91b3-8c539b40ddee None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:05.314443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:05.315362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:05.315641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:05.315914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] PATH_INFO: `/v3/projects/1102a94e50294918b0bd2dc6ae79f753/users/2d692125456a4e128d87c49b7b61750b/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:05.318123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] RBAC: Authorizing `identity:create_grant(project_id=1102a94e50294918b0bd2dc6ae79f753, user_id=2d692125456a4e128d87c49b7b61750b, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:05.319595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9df441-c064-4746-a0fd-def404c36b9f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:05.335679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 583/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:19:05 2022] PUT /identity/v3/projects/1102a94e50294918b0bd2dc6ae79f753/users/2d692125456a4e128d87c49b7b61750b/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:19:07.301983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ccf-6ee7-4a66-9096-0c78035a81a7 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:07.302901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ccf-6ee7-4a66-9096-0c78035a81a7 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:07.302901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ccf-6ee7-4a66-9096-0c78035a81a7 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:07.305123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 571/1154] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:07.310586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:07.311052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:07.311246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:07.329698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:07.330920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:07.340115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:07.400234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 584/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:07.423616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8ccf-6ee7-4a66-9096-0c78035a81a7 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:07.450809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:07.528494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8ccf-6ee7-4a66-9096-0c78035a81a7 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:07.563287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:07.564013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:07.564296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:07.564568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:07.576256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:07.584316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:07.585379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:19:07.586248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 572/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:07.592018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:07.696208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9d3b-1ae2-4671-91bb-0a95579652a4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:07.734548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:07.735263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:07.735546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:07.735822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:07.736581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:07.736892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:07.738276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:07.747246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 585/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:07.753195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:07.842160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:07.859038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e14a5-3375-460d-bf1a-7af2538cbde7 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:07.893380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:07.894276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:07.894545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:07.894831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] PATH_INFO: `/v3/users/2d692125456a4e128d87c49b7b61750b` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:07.896166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] RBAC: Authorizing `identity:get_user(user_id=2d692125456a4e128d87c49b7b61750b)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:07.897609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:07.899276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 573/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:07 2022] GET /identity/v3/users/2d692125456a4e128d87c49b7b61750b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:07.905505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:07.916173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:08.012465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae753-a482-4040-92c6-33ba0d6c5de1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:08.047525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:08.048168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:08.048456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:08.048732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:08.127727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:08.129105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:08.137029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:08.243751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 586/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:08.253360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:08.353746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4b94-5479-430a-9ab3-af7f5d745078 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:08.388715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:08.389567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:08.389842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:08.390116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] PATH_INFO: `/v3/projects/1102a94e50294918b0bd2dc6ae79f753` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:08.391428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] RBAC: Authorizing `identity:get_project(project_id=1102a94e50294918b0bd2dc6ae79f753)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:08.392849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439b03-02e5-457d-807a-15053e38c514 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:08.394501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 574/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:08 2022] GET /identity/v3/projects/1102a94e50294918b0bd2dc6ae79f753 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:08.404500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:08.507067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9fb7c-b0a9-4ea6-9b23-c99c723ee610 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:08.514974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:08.543290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:08.543943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:08.544219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:08.544486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:08.545308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=1102a94e50294918b0bd2dc6ae79f753, user.id=2d692125456a4e128d87c49b7b61750b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:08.545622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:08.547071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6202b6-1a84-4d34-b4a3-33ddefbf734c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:08.552978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 587/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:08 2022] GET /identity/v3/role_assignments?user.id=2d692125456a4e128d87c49b7b61750b&scope.project.id=1102a94e50294918b0bd2dc6ae79f753&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:10.588913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d984f-13d0-4e20-ab22-bc62bbbbb1a2 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:10.589811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d984f-13d0-4e20-ab22-bc62bbbbb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:10.589957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d984f-13d0-4e20-ab22-bc62bbbbb1a2 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:10.592183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 575/1162] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:10.597530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:10.597942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:10.598031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:10.616618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:10.617785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:10.687534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 588/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:10.709485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d984f-13d0-4e20-ab22-bc62bbbbb1a2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:10.735896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:10.840083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d984f-13d0-4e20-ab22-bc62bbbbb1a2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:10.876926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:10.877565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:10.877849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:10.878121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:10.948197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:10.949675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:10.972531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:11.055835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 576/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:11.065608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:11.172949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:11.178026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54237b53-c8cc-4a33-b514-986ef4e64099 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:11.225275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:11.226091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:11.226373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:11.226647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:11.233865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:11.235367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4603cd11-b64b-4e71-a104-6b37c2e62041 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:11.249745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:11.250939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:11.251935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 589/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:19:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:11.257747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:11.378162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ce9ef-0628-450f-bf77-6947a9ebdc73 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:11.399221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:11.416339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:11.417001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:11.417281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:11.417540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:11.418291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:11.418594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:11.420012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972a794-b826-46aa-b0f3-ab080e5192b6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:11.428316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 577/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Fri Jul 15 19:19:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:13.408760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67fa7-1a88-4c8f-8801-38ba665ec8bc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:13.409354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67fa7-1a88-4c8f-8801-38ba665ec8bc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:13.409659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67fa7-1a88-4c8f-8801-38ba665ec8bc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:13.411403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 590/1167] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:13.418493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28269-61ac-42d6-92a3-eef2bc56fe29 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:13.419148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28269-61ac-42d6-92a3-eef2bc56fe29 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:13.419342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28269-61ac-42d6-92a3-eef2bc56fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:13.444853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c5f28269-61ac-42d6-92a3-eef2bc56fe29 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:13.446762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c5f28269-61ac-42d6-92a3-eef2bc56fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:13.526453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 578/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:13.556043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67fa7-1a88-4c8f-8801-38ba665ec8bc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:13.669721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67fa7-1a88-4c8f-8801-38ba665ec8bc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:13.713040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:13.713701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:13.713984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:13.714263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:13.715095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:13.716492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332476c-bd25-4e7c-9b1d-5cc747372e5e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:13.734182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 591/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Fri Jul 15 19:19:13 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:19:15.762027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1ce8-a645-41a1-ba49-ecce9c68dc2c None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:15.762925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1ce8-a645-41a1-ba49-ecce9c68dc2c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:15.763217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1ce8-a645-41a1-ba49-ecce9c68dc2c None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:15.765463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 579/1170] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:15.771768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:15.772459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:15.772638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:15.796530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:15.797730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:15.812996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:15.869735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 592/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:15.899633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1ce8-a645-41a1-ba49-ecce9c68dc2c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:16.009810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1ce8-a645-41a1-ba49-ecce9c68dc2c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:16.025644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:16.047396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:16.048265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:16.048549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:16.048823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] PATH_INFO: `/v3/domains/83c7939a8a844f53a90dad76baaae58f` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:16.059389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=83c7939a8a844f53a90dad76baaae58f)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:16.060841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7419-6c62-4a8c-9023-b9536791d262 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:16.062446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 580/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Fri Jul 15 19:19:15 2022] GET /identity/v3/domains/83c7939a8a844f53a90dad76baaae58f => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:16.069319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:16.175788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b703a-9c9c-462b-9098-cac94e66a7d8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:16.217354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:16.218012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:16.218296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:16.218576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:16.219320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:16.220779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef04b-f80c-4323-807c-56a3d52d5a8f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:16.247529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 593/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:19:16 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:19:18.274109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b77bc-007d-45bb-8fe4-b33b05da5ba9 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:18.274700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b77bc-007d-45bb-8fe4-b33b05da5ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:18.274700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b77bc-007d-45bb-8fe4-b33b05da5ba9 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:18.276261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 581/1174] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:18.282759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:18.283541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:18.283671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:18.292698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:18.312193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:18.313405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:18.383081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 594/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:18.407550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b77bc-007d-45bb-8fe4-b33b05da5ba9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:18.521468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b77bc-007d-45bb-8fe4-b33b05da5ba9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:18.560801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:18.561616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:18.561896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:18.562170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] PATH_INFO: `/v3/domains/83c7939a8a844f53a90dad76baaae58f` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:18.563489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] RBAC: Authorizing `identity:get_domain(domain_id=83c7939a8a844f53a90dad76baaae58f)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:18.564942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c2330-32ae-48ea-b247-2a049911484a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:18.566573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 582/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Fri Jul 15 19:19:18 2022] GET /identity/v3/domains/83c7939a8a844f53a90dad76baaae58f => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:18.572685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:18.676737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1be87-7d59-4e7c-93c8-2b204fce43f5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:18.708641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:18.717768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:18.718831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:18.719247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:18.719645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:18.720756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:18.723103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf45838-317f-4ab3-b756-3b3ef44036db None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:18.748352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 595/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:19:18 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:19:20.818105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc0a3-d930-4bbc-bdf4-20e8385eb080 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:20.818836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc0a3-d930-4bbc-bdf4-20e8385eb080 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:20.818959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc0a3-d930-4bbc-bdf4-20e8385eb080 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:20.821134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 583/1178] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:20.826814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:20.827231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:20.827422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:20.845310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:20.846507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:20.928517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 596/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:20.952077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc0a3-d930-4bbc-bdf4-20e8385eb080 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:21.013783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:21.073603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc0a3-d930-4bbc-bdf4-20e8385eb080 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:21.108013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:21.108792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:21.109064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:21.109334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:21.120560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:21.128153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:21.129208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:19:21.130803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 584/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:21.138270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:21.242268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2273-8fb1-4f1b-8123-d65f658395bc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:21.260763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:21.280465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:21.281141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:21.281422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:21.281701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:21.282453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:21.282765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:21.284174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:21.292421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 597/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:21.300652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:21.407368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfea23-ebec-4a73-a074-4a1fa69b4dc2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:21.408957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:21.445760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:21.446630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:21.446943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:21.447213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] PATH_INFO: `/v3/users/4a442f3b5997438291fe2b6ac8793532` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:21.460874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] RBAC: Authorizing `identity:get_user(user_id=4a442f3b5997438291fe2b6ac8793532)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:21.462332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:21.464018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 585/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:21 2022] GET /identity/v3/users/4a442f3b5997438291fe2b6ac8793532 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:21.473747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:21.602315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64116a1a-e6b4-4409-a87f-d15380926f56 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:21.637139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:21.637778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:21.638058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:21.638335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:21.698277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:21.722106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:21.723603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:21.847922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 598/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:21.854168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:21.962396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825e81-7171-4589-a4e0-81fb0c405176 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:21.997938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:21.998826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:21.999110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:21.999375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] PATH_INFO: `/v3/projects/92c5da1baec1427d8a1f0837554ae1ff` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:22.000623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=92c5da1baec1427d8a1f0837554ae1ff)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:22.002068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0abf-94d5-43bc-9e34-a8fa509adbd2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:22.003904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 586/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:21 2022] GET /identity/v3/projects/92c5da1baec1427d8a1f0837554ae1ff => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:22.010345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:22.099527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:22.126056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f5a85-c8aa-4b98-b61e-4519230d7c2e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:22.164034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:22.164693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:22.164974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:22.165247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:22.166074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=92c5da1baec1427d8a1f0837554ae1ff, user.id=4a442f3b5997438291fe2b6ac8793532) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:22.166382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:22.167851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085b58-d78e-41de-9412-0481c7456ad1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:22.173696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 599/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:22 2022] GET /identity/v3/role_assignments?user.id=4a442f3b5997438291fe2b6ac8793532&scope.project.id=92c5da1baec1427d8a1f0837554ae1ff&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:24.135446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc07a6-25b9-40d0-9863-416e4f9ee754 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.136311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc07a6-25b9-40d0-9863-416e4f9ee754 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.136311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc07a6-25b9-40d0-9863-416e4f9ee754 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.138742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 587/1186] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:24.145072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.145825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.145994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.172625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:24.173830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:24.243486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 600/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:24.265950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc07a6-25b9-40d0-9863-416e4f9ee754 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:24.299090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:24.382103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc07a6-25b9-40d0-9863-416e4f9ee754 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:24.417541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:24.418260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.418546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.418822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.430115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:24.437897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:24.438949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:19:24.439843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 588/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:24.446341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:24.527744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:24.556271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2979b-2142-409a-a262-86324fb80a68 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:24.591977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:24.592641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.592926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.593199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.593953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:24.594262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:24.595668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:24.608796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 601/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:24.614884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:24.708783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:24.722488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279a96-990c-4598-988e-5f87d22f46e0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:24.755328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:24.756189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.756482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.756751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] PATH_INFO: `/v3/users/4a442f3b5997438291fe2b6ac8793532` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.757935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] RBAC: Authorizing `identity:get_user(user_id=4a442f3b5997438291fe2b6ac8793532)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:24.759408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:24.761015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 589/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:24 2022] GET /identity/v3/users/4a442f3b5997438291fe2b6ac8793532 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:24.766977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:24.868875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d75ec-f992-4d5b-b6f5-bfabcf167b34 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:24.903345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:24.904225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:24.904504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:24.904768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] PATH_INFO: `/v3/projects/92c5da1baec1427d8a1f0837554ae1ff` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:24.906053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] RBAC: Authorizing `identity:get_project(project_id=92c5da1baec1427d8a1f0837554ae1ff)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:24.907638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82112903-6079-428f-ac67-f7d7bcbf9085 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:24.909279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 602/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:24 2022] GET /identity/v3/projects/92c5da1baec1427d8a1f0837554ae1ff => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:24.916200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:25.037923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec3ba-5664-4cf0-bdf9-9b8bd816a741 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:25.072820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:25.073706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:25.073983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:25.074254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] PATH_INFO: `/v3/projects/92c5da1baec1427d8a1f0837554ae1ff/users/4a442f3b5997438291fe2b6ac8793532/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:25.076482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=92c5da1baec1427d8a1f0837554ae1ff, user_id=4a442f3b5997438291fe2b6ac8793532, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:25.077921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdeae3-ace0-410d-ba87-93beeb534a2a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:25.093289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 590/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:19:24 2022] PUT /identity/v3/projects/92c5da1baec1427d8a1f0837554ae1ff/users/4a442f3b5997438291fe2b6ac8793532/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:19:27.057385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79366f-846b-41da-959c-50b79b0cb024 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.058191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79366f-846b-41da-959c-50b79b0cb024 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.058191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79366f-846b-41da-959c-50b79b0cb024 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.060301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 603/1193] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:27.066006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.066434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.066533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.085521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:27.086725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:27.098385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:27.157782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 591/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:27.180995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79366f-846b-41da-959c-50b79b0cb024 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:27.185603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:27.294765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79366f-846b-41da-959c-50b79b0cb024 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:27.331217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:27.331945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.332219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.332483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.342959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:27.353349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:27.354420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:19:27.355665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 604/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:27.363290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:27.479796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b9cc3-27bf-46ac-a791-dfae05f2db85 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:27.522633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:27.523324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.523600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.523867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.524614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:27.524911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:27.526286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:27.534725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 592/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:27.541003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:27.609034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:27.649884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f381108-adf8-41b5-a275-a774a8aea88c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:27.690158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:27.691075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.691361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.691638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] PATH_INFO: `/v3/users/4a442f3b5997438291fe2b6ac8793532` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.692853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a442f3b5997438291fe2b6ac8793532)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:27.694324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:27.696010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 605/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Fri Jul 15 19:19:27 2022] GET /identity/v3/users/4a442f3b5997438291fe2b6ac8793532 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:27.702088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:27.715512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:27.813498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4393-2fe5-4b4d-8d97-9d2a91670ae0 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:27.849014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:27.849670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:27.849950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:27.850222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:27.939697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:27.941179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:27.958461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:28.052051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 593/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:28.058342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:28.167203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9825d-d683-4edd-8c42-f601bd09c4c3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:28.196648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:28.203827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:28.204698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:28.204979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:28.205231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] PATH_INFO: `/v3/projects/92c5da1baec1427d8a1f0837554ae1ff` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:28.206487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] RBAC: Authorizing `identity:get_project(project_id=92c5da1baec1427d8a1f0837554ae1ff)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:28.207962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa453339-175f-4a11-8fe9-bfe81b6392b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:28.209656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 606/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Fri Jul 15 19:19:28 2022] GET /identity/v3/projects/92c5da1baec1427d8a1f0837554ae1ff => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:28.216110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:28.336756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b1a-2994-462c-a074-59b4b4d7b73f None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:28.346702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:28.373427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:28.374084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:28.374361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:28.374739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:28.375595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=92c5da1baec1427d8a1f0837554ae1ff, user.id=4a442f3b5997438291fe2b6ac8793532) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:28.375907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:28.377347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85338ae9-447b-4100-b78f-809b8ccb41c5 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:28.383267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 594/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:28 2022] GET /identity/v3/role_assignments?user.id=4a442f3b5997438291fe2b6ac8793532&scope.project.id=92c5da1baec1427d8a1f0837554ae1ff&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:38.380649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=14 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:23.235452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f9bb-ed55-4b85-8fa4-d4294b3d1bbf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:23.236044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f9bb-ed55-4b85-8fa4-d4294b3d1bbf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:23.236044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f9bb-ed55-4b85-8fa4-d4294b3d1bbf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:23.237759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 607/1201] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:23.243430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:23.243917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:23.244016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:23.263159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:23.264623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:23.350040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 595/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:23.375898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f9bb-ed55-4b85-8fa4-d4294b3d1bbf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:23.499076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f9bb-ed55-4b85-8fa4-d4294b3d1bbf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:23.538500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:23.539354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:23.539635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:23.539908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:23.555143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:23.556807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:23.579703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:23.580867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:23.582016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:23.582016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:23.582016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:23.582016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:23.583655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 608/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:23.589723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:23.714134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b902-55f5-421e-a635-1c1873a4b066 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:23.748118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:23.756037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:23.757001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:23.757379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:23.757599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:23.758366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:23.758699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:23.761663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3af45-a783-46eb-bb6d-ad699d40772d None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:23.774658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 596/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:23.778824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:23.849089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:23.916304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e210-12bc-415f-970b-003b6cf2aa64 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:23.955941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:23.956628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:23.956905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:23.957175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:23.957884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:23.959404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245169c-4432-4eb0-a37c-0744d59d7441 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:23.987578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 609/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Fri Jul 15 19:20:23 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:20:26.127009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37674d-1f52-4c10-a8c3-a49bdc176989 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:26.127523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37674d-1f52-4c10-a8c3-a49bdc176989 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:26.127523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37674d-1f52-4c10-a8c3-a49bdc176989 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:26.128885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 597/1206] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:26.136895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:26.136895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:26.136895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:26.153702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:26.154992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:26.236805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 610/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:26.261279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37674d-1f52-4c10-a8c3-a49bdc176989 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:26.385771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37674d-1f52-4c10-a8c3-a49bdc176989 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:26.423689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:26.424506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:26.424789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:26.425063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:26.436729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:26.445368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:26.446691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:26.447889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 598/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:20:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:26.455916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:26.495530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:26.560081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5dfa-64d0-4eb5-a489-98b4c906e1cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:26.604261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:26.605050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:26.605337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:26.605631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:26.606475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:26.606946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:26.608338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:26.618984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 611/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:20:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:26.623081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:26.688696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:26.749230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9f0f-9064-40b3-89b9-ebfc2e70810e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:26.798143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:26.798446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:26.798712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:26.798984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:26.809805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:26.811306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:26.833648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:26.835045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:26.836227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:26.836227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:26.836227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:26.836227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:26.836664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 599/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:26.843263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:26.960306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:26.963468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9421e-6844-499a-95d6-e6e4f24cd117 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:27.000976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:27.001760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:27.002046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:27.002350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:27.003121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:27.003430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:27.004929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:27.023030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 612/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:27.024608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:27.143303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7354a-27db-4007-8d7e-3a73988eabb8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:27.145053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:27.184257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:27.185722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:27.185722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:27.185910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:27.193886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:27.195522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:27.213133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:27.214336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:27.215417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 600/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:27.221057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:27.336930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9f49-a02e-4c95-886d-fe9c6621d038 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:27.372786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:27.374116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:27.374116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:27.374442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:27.375706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:27.376131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:27.378323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:27.398420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 613/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:27.404433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:27.533944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b2af-9c39-48c9-96ea-f6dca7582e46 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:27.579648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:27.580430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:27.580718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:27.581077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:27.617590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:27.663336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:27.664997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:27.783171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 601/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:20:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:20:27.792931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:27.812874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:27.913187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149692c-7448-4030-a74f-a1974317f10d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:27.950071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:27.951287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:27.951765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:27.952703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:27.965730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:27.967671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:27.987074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:27.988392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:27.989272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:27.989272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:27.989272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:27.989272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:27.989272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 614/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:27.994273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:28.066141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:28.111870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b874-66b1-4815-939c-a9480a843d98 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:28.151622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:28.152467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:28.152800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:28.153201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:28.154109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:28.154514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:28.156196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:28.169300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 602/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:28.175475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:28.255707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:28.299135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f33b-8d33-4bfc-8f4e-e9effb49adb9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:28.337597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:28.338329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:28.338609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:28.338914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:28.346139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:28.347844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:28.362619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:28.363830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:28.364740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 615/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:28.369991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:28.484636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada3325-c6ba-4802-a9d1-71221449680e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:28.514691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:28.535686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:28.536550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:28.536823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:28.537217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:28.538077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:28.538404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:28.539932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067758-7f03-4c2f-8258-9173774c7e98 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:28.558718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 603/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:28.560060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:28.672587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510218f-ad06-4b76-ad2f-97a38a9db77c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:28.701484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:28.709547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:28.710335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:28.710686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:28.711059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:28.712033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=0768be15edd043a6a24a14d023baff4f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:28.712419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:28.713988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef625f-ca97-4d62-94b3-ed1f1f5bb79b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:28.719869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 616/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:20:28 2022] GET /identity/v3/role_assignments?user.id=0768be15edd043a6a24a14d023baff4f&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:30.724570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f070-6c1d-4ebe-965a-c19df405a101 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:30.725125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f070-6c1d-4ebe-965a-c19df405a101 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:30.725250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f070-6c1d-4ebe-965a-c19df405a101 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:30.727026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 604/1220] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:30.733052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:30.733515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:30.733622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:30.750911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:30.752122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:30.824543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 617/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:20:30.852364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f070-6c1d-4ebe-965a-c19df405a101 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:30.966515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f070-6c1d-4ebe-965a-c19df405a101 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.006650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.007419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.007697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.007977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.018936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:31.027334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:31.028562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:31.029688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 605/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:31.036817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:31.147185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6941-517b-4aec-9013-5defb9a9e8fb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.172162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:31.185660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.186411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.186697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.187045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.187794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:31.188106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:31.189540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:31.203868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 618/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:31.205304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:31.250064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:31.312496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a941d-e1c2-48a1-bfad-b36263b27ff9 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.347981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.348876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.349158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.349453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.361696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:31.363230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:31.381631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:31.382743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:31.383833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:31.383833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:31.383833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:31.383833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:31.383833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 606/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:31.388892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:31.498134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e76-aff2-4a8c-b279-074909264eba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.534252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.534961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.535249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.535572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.536256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:31.536567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:31.537965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:31.550409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 619/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:31.556036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:31.653683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:31.660741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82719b2-89d0-4faf-8cd6-ac244775ed4a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.695763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.696586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.696866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.697136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] PATH_INFO: `/v3/users/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.705565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:31.707165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:31.722205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:31.723397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:31.724472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 607/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:31.729928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:31.784387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:31.845678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fd2f-ae38-499e-89c4-6c3dc1eb0727 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:31.884065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:31.884861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:31.885172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:31.885448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:31.886293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:31.886608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:31.888391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:31.906094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 620/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:31.912117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:32.021714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14dfb9-bf99-4434-91b2-efe0d62732da None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:32.056863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:32.057667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:32.057943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:32.058211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:32.068692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:32.070133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:32.088975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:32.090055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:32.091928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:32.091928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:32.091928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:32.091928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:32.098588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 608/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:32.098731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:32.206835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba590a5-c2ff-4c62-8b23-d1c652dc4208 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:32.209566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:32.246961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:32.247748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:32.248085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:32.248368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:32.249191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:32.249503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:32.251006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:32.263480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 621/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:32.269432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:32.280058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:32.372109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae759db-f27c-42cc-bc3c-f5585145aa47 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:32.413257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:32.414064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:32.414340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:32.414607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:32.421591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:32.423067 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:32.437672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:32.438737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:32.439651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 609/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:32.444979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:32.562732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c9f3-26ac-42fb-bbc3-27bf6ff3d1f2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:32.602559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:32.603264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:32.603538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:32.603805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:32.604597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:32.604901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:32.606480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ed70-ccff-47f2-89aa-e99fe66cd274 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:32.619187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 622/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:32.625543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:32.694110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:32.733119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c599e3-dfde-4232-975d-604d0a2768f6 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:32.769870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:32.770992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:32.771271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:32.771573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/0768be15edd043a6a24a14d023baff4f/roles/b4348b03dce8420791a7c77def294d5a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:32.789405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=0768be15edd043a6a24a14d023baff4f, role_id=b4348b03dce8420791a7c77def294d5a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:32.791424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a464870-073b-4fc1-be67-6230b1702ec3 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:32.807594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 610/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:20:32 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/0768be15edd043a6a24a14d023baff4f/roles/b4348b03dce8420791a7c77def294d5a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:20:34.915967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b27bc-900b-4502-b1a9-5ebe20802a00 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:34.916535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b27bc-900b-4502-b1a9-5ebe20802a00 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:34.916535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b27bc-900b-4502-b1a9-5ebe20802a00 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:34.917853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 623/1233] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:34.923647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:34.924308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:34.924308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:34.942364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:34.943743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:35.022702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 611/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:20:35.047606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b27bc-900b-4502-b1a9-5ebe20802a00 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:35.075090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:35.154950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b27bc-900b-4502-b1a9-5ebe20802a00 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:35.193413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:35.194232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:35.194510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:35.194800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:35.207212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:35.214966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:35.216256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:35.217078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 624/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:35.222950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:35.269104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:35.324309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5114-d310-4ccf-8984-0b85c010cb5f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:35.358492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:35.359201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:35.359476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:35.359750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:35.360487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:35.360789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:35.362132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:35.370748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 612/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:35.377627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:35.461340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:35.477281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fc35b-ef6c-4989-b5db-8ae297a682ed None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:35.517320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:35.517922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:35.518201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:35.518575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:35.530525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:35.532490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:35.552685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:35.553782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:35.554859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:35.554859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:35.554859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:35.554859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:35.554859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 625/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:35.560103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:35.663988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d3ac-f800-4ad1-a855-b739b504aa5c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:35.675550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:35.703649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:35.704318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:35.704596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:35.704866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:35.705589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:35.705894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:35.707321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:35.719694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 613/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:35.725497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:35.837934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bdca2-ff17-410e-89ec-273d61803fda None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:35.880623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:35.882234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:35.882768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:35.883427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:35.887819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:35.895272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:35.897037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:35.916415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:35.917985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:35.918943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 626/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:35.924291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:36.034501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9b63-89fa-441f-9340-cad057b5d9ff None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:36.070268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:36.070990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:36.071272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:36.071548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:36.072389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:36.072702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:36.074155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:36.093975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 614/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:36.100541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:36.214875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6110f1-9d4a-4322-9c05-5bff14cc901b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:36.253151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:36.253952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:36.254275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:36.254607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:36.321921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:36.329295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:36.330773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:36.437483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 627/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:20:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:20:36.443633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:36.475108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:36.568729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c6283-7c4b-4759-a133-f990cb562037 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:36.611807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:36.612794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:36.613102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:36.613384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:36.624677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:36.626335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:36.644825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:36.646030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:36.647138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:36.647138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:36.647138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:36.647138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:36.647138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 615/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:36.654059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:36.756742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:36.763699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30879fe9-9455-4212-9db8-72653f7a7150 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:36.804940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:36.805700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:36.805945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:36.806173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:36.806977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:36.807282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:36.808706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:36.822741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 628/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:36.829011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:36.911218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:36.935161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763cc68-6e84-4164-b622-b928aad24d5a None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:36.973823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:36.974639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:36.974947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:36.975222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:36.983499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:36.984971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:36.998989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:36.999991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:37.000858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 616/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:37.006419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:37.114923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dad4-3592-46cb-874b-24c856d5558a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:37.149634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:37.150308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:37.150590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:37.150933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:37.151849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:37.152164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:37.153793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba935752-fe59-4cbe-81be-e7e12e2784db None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:37.167866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 629/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:37.174408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:37.283174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a49224-371d-47d7-bf04-78cd536085e2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:37.323312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:37.324050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:37.324370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:37.324700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:37.325644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] RBAC: Adding query filter params (role.id=b4348b03dce8420791a7c77def294d5a, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=0768be15edd043a6a24a14d023baff4f) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:37.326013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:37.328132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd12b8-1089-4bcf-a538-5227fab3b47b None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:37.335414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 617/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:20:37 2022] GET /identity/v3/role_assignments?user.id=0768be15edd043a6a24a14d023baff4f&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=b4348b03dce8420791a7c77def294d5a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:39.511458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb3b88-a345-4a6e-ad60-5e088d9d9334 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:39.512093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb3b88-a345-4a6e-ad60-5e088d9d9334 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:39.512093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb3b88-a345-4a6e-ad60-5e088d9d9334 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:39.513396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 630/1247] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:20:39.519929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:39.520363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:39.520632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:39.527234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:39.542147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:39.543476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:39.622618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 618/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:39.647906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb3b88-a345-4a6e-ad60-5e088d9d9334 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:39.667376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:39.758821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb3b88-a345-4a6e-ad60-5e088d9d9334 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:39.801104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:39.802002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:39.802360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:39.802699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:39.813391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:39.821098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:39.822288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:39.823175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 631/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:20:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:39.829005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:39.938134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5fee2-746a-47eb-ab0e-2a041ec1bd63 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:39.970500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:39.976553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:39.977562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:39.977852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:39.978304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:39.979097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:39.979408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:39.980808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:39.989963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 619/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:39.996122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:40.086423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:40.114470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf656-24e9-4e7c-8697-08cb655e7227 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:40.154081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:40.154924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:40.155203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:40.155474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:40.166660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:40.168158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:40.187018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:40.188184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:40.189056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:40.189056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:40.189056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:40.189056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:40.189056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 632/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:40.194717 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:40.314059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cc60-fde2-474a-a866-2cf8c97b3794 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:40.353529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:40.354138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:40.354421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:40.354696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:40.355623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:40.356020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:40.357547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:40.371048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 620/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:40.377030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:40.494810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabdfc3-9f1a-4d0c-b320-1047364ee888 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:40.526964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:40.538691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:40.539596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:40.539880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:40.540157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:40.549147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:40.550907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:40.570759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:40.571864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:40.572791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 633/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:40.579212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:40.648123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:40.702929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec649d2-5e7a-4421-bc7e-0468c248a09e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:40.740222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:40.740970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:40.741213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:40.741559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:40.742524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:40.742894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:40.744560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:40.763735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 621/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:40.770327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:40.879057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ce991-57d7-4547-a9f4-72ac4d962f52 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:40.913567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:40.914135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:40.914450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:40.914689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:40.980148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:40.995119 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:40.996634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:41.118261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 634/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:20:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:20:41.124348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:41.241060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f9c4-a231-4afc-a730-0e369b939358 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:41.255560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:41.281197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:41.281997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:41.282273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:41.282546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:41.294038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:41.296057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:41.315978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:41.317051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:41.318122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:41.318122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:41.318122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:41.318122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:41.319761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 622/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:41.325734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:41.426082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:41.439753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517900d-5511-438d-83c8-4d2fabc73a18 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:41.479240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:41.480041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:41.480344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:41.480587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:41.481554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:41.481830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:41.483397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:41.497122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 635/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:41.503335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:41.622744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d29b6-4867-4524-851f-aa6067472cd4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:41.659584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:41.660383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:41.660637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:41.660904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:41.668110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:41.669613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:41.683748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:41.685116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:41.686338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 623/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:41.691303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:41.805020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def30-343f-48d5-9918-f93fbcde49af None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:41.843910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:41.844712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:41.845102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:41.845388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:41.846377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:41.846693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:41.848471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58a29-834f-4f96-bf7b-e3a5c4358da7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:41.862310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 636/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:41.868895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:41.902140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:41.979620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0995a-719b-4355-9a29-682b73c681bd None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:42.014503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:42.015241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:42.015525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:42.015801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:42.016631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=0768be15edd043a6a24a14d023baff4f) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:42.016943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:42.018422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be64ac-75bf-473d-9676-c4eac992d01f None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:42.023891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 624/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:20:41 2022] GET /identity/v3/role_assignments?user.id=0768be15edd043a6a24a14d023baff4f&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:44.036939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da87-8fff-4a23-90f2-ceeaac91b8a9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.037489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da87-8fff-4a23-90f2-ceeaac91b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.037489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da87-8fff-4a23-90f2-ceeaac91b8a9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.039159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 637/1261] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:44.045251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.045975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.046099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.069131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:44.070266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:44.146721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 625/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:44.169090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8da87-8fff-4a23-90f2-ceeaac91b8a9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:44.181471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:44.283571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8da87-8fff-4a23-90f2-ceeaac91b8a9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:44.318170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:44.318992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.319334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.319536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.330734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:44.338274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:44.339352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:44.340349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 638/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:44.345914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:44.365625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:44.453401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cdbec-e9e8-4fe8-8438-949e76a63e21 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:44.488504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:44.489169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.489454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.489732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.490476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:44.490819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:44.492176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:44.500634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 626/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:44.507152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:44.578358 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:44.621582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248b86-0f28-41d8-a2ca-3eef9c66b013 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:44.657847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:44.658639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.658957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.659232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.670025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:44.671517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:44.688679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:44.689656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:44.690991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:44.690991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:44.690991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:44.690991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:44.690991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 639/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:44.695906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:44.783307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:44.804230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fc8b9-c9e9-48e7-a1af-d8cfac59aa54 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:44.839082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:44.839663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:44.839947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:44.840277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:44.841001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:44.841314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:44.842696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:44.854546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 627/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:44.860724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:44.968923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4fff-8933-4573-94ec-b9f62771e060 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:44.995763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:45.012073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.012874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.013157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.013430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.021267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.022746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:45.037390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:45.042419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:45.043588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 640/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:45.045053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:45.158604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a651d17-8b3c-49ba-9fed-640a09af4729 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:45.193551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.194217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.194498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.194775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.195644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:45.195955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.197401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.206624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:45.215919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 628/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:45.221864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:45.347702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08595077-c720-4d09-bfa7-4cdaa20cda35 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:45.384075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.384863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.385146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.385426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.396555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.398015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:45.415373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:45.416337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:45.417239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:45.417239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:45.417239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:45.417239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:45.417239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 641/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:45.422475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:45.533698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad950604-adc4-49c5-a490-e5cb251aedce None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:45.568680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.569346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.569625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.569902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.570621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:45.570959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.572331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.584300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 629/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:45.590416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:45.628062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:45.697761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974d6ac-a32c-4dd5-a6d8-009e04425f8a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:45.736790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.738014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.738450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.738938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.749792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.751292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:45.766245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:45.767269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:45.768148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 642/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:45.775088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:45.841539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:45.885428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd98c-fcf1-4f49-8178-70990abb60b8 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:45.924366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:45.925010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:45.925350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:45.925535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:45.926829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:45.927226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:45.928676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c251e5-65ae-4bff-99c7-f99dd27e0361 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:45.940915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 630/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:45.950979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:46.047634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:46.064202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7e88-b160-4e40-9488-f321390d292e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:46.105197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:46.106094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:46.106372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:46.106645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] PATH_INFO: `/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/0768be15edd043a6a24a14d023baff4f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:46.109034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] RBAC: Authorizing `identity:create_grant(project_id=02824b2f4461499a890e7c6fa127ed61, user_id=0768be15edd043a6a24a14d023baff4f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:46.110491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463889-57cf-44db-bb42-14d27a296f6e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:46.129395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 643/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Fri Jul 15 19:20:45 2022] PUT /identity/v3/projects/02824b2f4461499a890e7c6fa127ed61/users/0768be15edd043a6a24a14d023baff4f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:20:48.067785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089529-1f08-41ab-b118-9f510ab2fc40 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.068330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089529-1f08-41ab-b118-9f510ab2fc40 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.068695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089529-1f08-41ab-b118-9f510ab2fc40 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.071048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 631/1274] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:48.079799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.080512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.080669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.109274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:48.110502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:48.182405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 644/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:48.213486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089529-1f08-41ab-b118-9f510ab2fc40 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:48.322632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089529-1f08-41ab-b118-9f510ab2fc40 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:48.340359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:48.359641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:48.360432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.360714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.360988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.373184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:48.380955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:48.382004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:48.382917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 632/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Fri Jul 15 19:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:48.388910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:48.477119 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:48.500018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9039e4-9cbe-463e-98e8-3cf8b90f5403 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:48.538708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:48.539458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.539764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.540009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.540828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:48.541073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:48.542535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:48.551246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 645/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Fri Jul 15 19:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:48.557495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:48.662346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6616-4b34-43a1-9975-9694ce32ecf2 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:48.697122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:48.697928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.698224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.698470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.710120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:48.711606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:48.728903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:48.729921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:48.731069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:48.731069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:48.731069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:48.731069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:48.731069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 633/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:48.737734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:48.839892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed290499-653b-40de-a9b9-e644d5e47adc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:48.877957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:48.878619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:48.878944 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:48.879221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:48.879952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:48.880259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:48.881639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:48.893649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 646/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:48.899493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:48.932983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:49.010317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7b12-6d14-4802-8fa0-afd891b4f546 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:49.046612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:49.047442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:49.047726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:49.047998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:49.057265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:49.058713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:49.074120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:49.075605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:49.077533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 634/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:49.082169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:49.086206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:49.182253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32dc1-f16f-46f5-b247-54d546bd50cd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:49.217304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:49.217988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:49.218266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:49.218537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:49.219402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:49.219703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:49.221147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:49.238016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 647/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:49.243997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:49.337510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:49.349446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab015-3568-4671-a5a4-c097199af2b4 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:49.385176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:49.385828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:49.386108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:49.386382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:49.460308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:49.462451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:49.562106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:49.578318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 635/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Fri Jul 15 19:20:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:20:49.584459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:49.653407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:49.695122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3870d-fd53-48d2-9eab-b0fb944ea73c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:49.731356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:49.732157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:49.732443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:49.732719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:49.743339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:49.744806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:49.762385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:49.763404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:49.764506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:49.764506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:49.764506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:49.764506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:49.764506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 648/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:49.769767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:49.871963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81a8df-4d53-40ce-acef-4aaa8a7caf2c None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:49.907701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:49.908355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:49.908587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:49.908894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:49.909617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:49.909926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:49.911339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:49.922722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 636/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:20:49.929289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:50.034600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526434a-a08a-403d-89ae-cc34825c2d58 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:50.048731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:50.071308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:50.072104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:50.072384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:50.072662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:50.080191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:50.081642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:50.095844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:50.097304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 15 19:20:50.098667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 649/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:50.103645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:50.157707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:50.210290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f693c2-d2e6-4eb0-b33e-bc70428d68ad None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:50.246734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:50.247425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:50.247704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:50.247977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:50.248757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:50.249066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:50.250583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd1c77-3476-447d-ada1-584e244232a0 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:50.262361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 637/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:50.268865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:50.400190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a0013-8e06-4bfc-b932-addf0ce9d50f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:50.436767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:50.437349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:50.437626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:50.437904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:50.438736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] RBAC: Adding query filter params (role.id=f2f6ba9fba3448b48067a6e828b81c42, scope.project.id=02824b2f4461499a890e7c6fa127ed61, user.id=0768be15edd043a6a24a14d023baff4f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:50.439088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:50.440522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf778bd4-c358-4cc9-96dc-f185b667b58e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:50.446607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 650/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Fri Jul 15 19:20:50 2022] GET /identity/v3/role_assignments?user.id=0768be15edd043a6a24a14d023baff4f&scope.project.id=02824b2f4461499a890e7c6fa127ed61&role.id=f2f6ba9fba3448b48067a6e828b81c42 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:52.474754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48687d-6484-4184-afee-7d865a80b0ae None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:52.475332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48687d-6484-4184-afee-7d865a80b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:52.475332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48687d-6484-4184-afee-7d865a80b0ae None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:52.476710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 638/1288] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:52.483092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:52.483832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:52.484019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:52.508238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:52.509501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:52.544642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:52.591296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 651/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:52.617167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48687d-6484-4184-afee-7d865a80b0ae None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:52.732041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48687d-6484-4184-afee-7d865a80b0ae None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:52.743323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:52.771194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:52.771997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:52.772272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:52.772544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:52.773191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:52.774557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:52.787676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:52.788844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:52.790027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 639/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:20:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:52.795187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:52.895924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41a06-b402-4969-802b-ed82b7307638 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:52.930556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:52.931242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:52.931518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:52.931788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:52.932491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:52.932797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:52.934162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f9a32-78d9-4693-b6a8-0acda78e6ca2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:52.939311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 652/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:52.945285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:53.050600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc69d-6536-44e1-80b8-dcb41376780e None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:53.086104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:53.086744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:53.087049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:53.087329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] PATH_INFO: `/v3/services` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:53.088026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:53.088335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:53.089680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bd1c8-7add-4133-91f7-d33599e6c036 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:53.094285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 640/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:55.061412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c6f3-e27e-4e72-89a8-cebcc96ae2b8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:55.062457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c6f3-e27e-4e72-89a8-cebcc96ae2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:55.062457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c6f3-e27e-4e72-89a8-cebcc96ae2b8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:55.064488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 653/1293] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:55.070830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea759-11a2-4b18-a22d-42d254f624e1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:55.071626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea759-11a2-4b18-a22d-42d254f624e1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:55.071809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea759-11a2-4b18-a22d-42d254f624e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:55.097072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-183ea759-11a2-4b18-a22d-42d254f624e1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:55.098270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-183ea759-11a2-4b18-a22d-42d254f624e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:55.128405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:55.167280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 641/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:55.190723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c6f3-e27e-4e72-89a8-cebcc96ae2b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:55.239433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:55.316112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c6f3-e27e-4e72-89a8-cebcc96ae2b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:55.351839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:55.352500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:55.352782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:55.353055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:55.353780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:55.355193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa35b2f-159b-4351-8781-94efedff7297 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:55.371057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 654/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Fri Jul 15 19:20:55 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:20:57.354561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe4f0-8e61-4be0-bb4a-52d991d81783 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:57.355174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe4f0-8e61-4be0-bb4a-52d991d81783 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:57.355174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe4f0-8e61-4be0-bb4a-52d991d81783 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:57.357240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 642/1296] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:57.366139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:57.366888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:57.367042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:57.392418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:57.393626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:57.471460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 655/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:57.494287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe4f0-8e61-4be0-bb4a-52d991d81783 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:57.607166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe4f0-8e61-4be0-bb4a-52d991d81783 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:57.641677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:57.642471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:57.642745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:57.643020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:57.643691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:57.645059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:57.660849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:57.661988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:20:57.662983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 643/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:20:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:57.668547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:57.691506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:57.779288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52ece-b610-4b94-90d0-34476a0e7d03 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:57.820689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:57.821402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:57.821683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:57.821958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:57.822668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:57.823122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:57.824515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:57.830678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 656/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:57.840725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:57.873818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:57.942045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe348da-c508-4d39-81c5-7f58751dfb66 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:57.977695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:57.978338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:57.978613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:57.978918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:57.979695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] RBAC: Adding query filter params (interface=public, service_id=d7924a755ff64bc3a114fbd4234c84dc, region_id=RegionOne) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:57.980003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:57.981366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84334bcd-0dbe-49fb-be0d-66bfba720c4c None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:57.986518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 644/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Fri Jul 15 19:20:57 2022] GET /identity/v3/endpoints?service_id=d7924a755ff64bc3a114fbd4234c84dc&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:57.992845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:58.080503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:58.100609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9217f-c885-4cb5-8017-b77af980fb2c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:58.136277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:58.136941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:58.137223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:58.137503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:58.138168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:58.139575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03e5e-fa17-4d93-be8b-303d93313df5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:58.146613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 657/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Fri Jul 15 19:20:57 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:21:00.123525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e960a-b529-4884-98bd-20949d0450cb None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:21:00.124495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e960a-b529-4884-98bd-20949d0450cb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:21:00.124495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e960a-b529-4884-98bd-20949d0450cb None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:21:00.126466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 645/1302] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:21:00.131921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d590-3928-4424-a347-b7b517328db6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:21:00.132353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d590-3928-4424-a347-b7b517328db6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:21:00.132446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d590-3928-4424-a347-b7b517328db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:21:00.151058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3524d590-3928-4424-a347-b7b517328db6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:21:00.152260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3524d590-3928-4424-a347-b7b517328db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:21:00.222414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 658/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:21:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:21:00.245201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e960a-b529-4884-98bd-20949d0450cb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:21:00.349006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:21:00.360537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e960a-b529-4884-98bd-20949d0450cb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:21:00.396635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:21:00.397455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:21:00.397734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:21:00.398008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:21:00.398668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:21:00.400080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:21:00.412197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:21:00.418294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application with Lock( Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: ERROR keystone.server.flask.application Jul 15 19:21:00.419346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 646/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Fri Jul 15 19:21:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:21:00.421642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d590-3928-4424-a347-b7b517328db6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:21:00.501055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:21:00.532609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d590-3928-4424-a347-b7b517328db6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:21:00.568222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:21:00.568900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:21:00.569187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:21:00.569472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:21:00.570188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:21:00.570498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:21:00.571925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd04b0-f760-436e-b8fe-50b134164709 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:21:00.578108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 659/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Fri Jul 15 19:21:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:21:00.584703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:21:00.700233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3d6e-6613-4e28-9e9d-2dd953fe3753 None admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:21:00.735486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:21:00.736127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:21:00.736405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:21:00.736674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:21:00.737403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:21:00.738770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a429fd-42cc-4109-985a-3e05fc4d61e7 None admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:21:00.759842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 647/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Fri Jul 15 19:21:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:21:10.574269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=30 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:21:10.755873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:03.344131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41d2d-f3b6-4dc1-bc4b-0b9ec7b78b39 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:03.344726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41d2d-f3b6-4dc1-bc4b-0b9ec7b78b39 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:03.344726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41d2d-f3b6-4dc1-bc4b-0b9ec7b78b39 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:03.346215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 660/1307] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:03.351916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303531e-27b0-4c9b-811e-1e2e72191536 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:03.352802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303531e-27b0-4c9b-811e-1e2e72191536 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:03.353295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303531e-27b0-4c9b-811e-1e2e72191536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:03.440589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5303531e-27b0-4c9b-811e-1e2e72191536 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:03.442321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5303531e-27b0-4c9b-811e-1e2e72191536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:03.647419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 648/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:03.696971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:03.697326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:03.697676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:03.699968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 661/1309] 10.222.0.57 () {54 vars in 964 bytes} [Fri Jul 15 19:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:03.705796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a9c72-5c72-48de-bd97-bd37c905d4f9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:03.706086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a9c72-5c72-48de-bd97-bd37c905d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:03.706369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a9c72-5c72-48de-bd97-bd37c905d4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:03.829292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cc1a9c72-5c72-48de-bd97-bd37c905d4f9 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:03.830946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cc1a9c72-5c72-48de-bd97-bd37c905d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:03.856981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:03.920652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 649/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Fri Jul 15 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:03.929592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:03.931369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:04.053502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc324b3-f5be-4a62-9d51-c172688c1d4e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:04.155018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:04.155711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:04.155991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:04.156287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:04.157923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:04.218203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:04.279293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:04.280813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8fd0-50d0-414d-891a-57684885d406 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:04.301227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 662/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:06.591390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:06.591945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:06.591945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:06.593343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 650/1312] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:06.598536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2769-0389-4145-b588-f3cbe2ec1d40 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:06.598995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2769-0389-4145-b588-f3cbe2ec1d40 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:06.599104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2769-0389-4145-b588-f3cbe2ec1d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:06.669751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7f0d2769-0389-4145-b588-f3cbe2ec1d40 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:06.671076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7f0d2769-0389-4145-b588-f3cbe2ec1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:06.791131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 663/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:06.826179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:06.827913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:06.946639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ecb8-3cd4-4ab3-aacb-4ba0ee3a8c00 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:07.020929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:07.025303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:07.026670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:07.027250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:07.027657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:07.030861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:07.147645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:07.149127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bb010-89da-42cd-8557-6c19e7ff4ec0 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:07.168151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 651/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:09.495118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541385-fa78-4966-966f-df79d468b7c0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:09.495694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541385-fa78-4966-966f-df79d468b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:09.495694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541385-fa78-4966-966f-df79d468b7c0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:09.496993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 664/1315] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:09.502552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b44c8-8c78-40c7-8cdb-cc8d79d86617 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:09.503015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b44c8-8c78-40c7-8cdb-cc8d79d86617 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:09.503106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b44c8-8c78-40c7-8cdb-cc8d79d86617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:09.571840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ff7b44c8-8c78-40c7-8cdb-cc8d79d86617 None None] MFA Rules not processed for user `d433e7449d234a78ae97850207c8abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:09.573092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ff7b44c8-8c78-40c7-8cdb-cc8d79d86617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:09.632251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:09.678958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 652/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:09.733607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:09.733868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:09.734174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:09.735594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 665/1317] 10.222.0.57 () {54 vars in 964 bytes} [Fri Jul 15 19:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:09.744104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab30-ad31-4e56-8492-8e72e4a3b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:09.744479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab30-ad31-4e56-8492-8e72e4a3b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:09.744832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab30-ad31-4e56-8492-8e72e4a3b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:09.833672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-93e9ab30-ad31-4e56-8492-8e72e4a3b4b1 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:09.834951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-93e9ab30-ad31-4e56-8492-8e72e4a3b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:09.912125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 653/1318] 10.222.0.57 () {58 vars in 1061 bytes} [Fri Jul 15 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:09.921054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:09.922592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:09.932336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:10.030681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16c9c7-1e06-4b9c-911d-4a5e6ffcd06b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:10.110223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:10.110896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:10.111174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:10.111442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:10.113085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:10.185887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:10.240265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:10.241740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50dd91-6049-4ef0-b464-be3c35abab4f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:10.260765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 666/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:13.211209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:13.211977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:13.212132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:13.213693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 654/1320] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:13.220500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b47af-2652-4f7e-89f6-793ed9bf8a6a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:13.220985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b47af-2652-4f7e-89f6-793ed9bf8a6a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:13.221078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b47af-2652-4f7e-89f6-793ed9bf8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:13.295384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b0b47af-2652-4f7e-89f6-793ed9bf8a6a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:13.296624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b0b47af-2652-4f7e-89f6-793ed9bf8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:13.395757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 667/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:13.438289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:13.440887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:13.494834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:13.559447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad9303-6938-4acc-b878-13429eae2e11 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:13.645711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:13.646382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:13.646672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:13.646977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:13.648630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:13.767210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:13.781743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:13.783262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce50e7-b36a-4830-8408-b2fb6b104f37 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:13.802977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 655/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:16.474686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:16.475307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:16.475307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:16.476799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 668/1323] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:16.481890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaede-34e2-49df-8cb3-4ebf327e9656 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:16.482306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaede-34e2-49df-8cb3-4ebf327e9656 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:16.482584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaede-34e2-49df-8cb3-4ebf327e9656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:16.550605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1c7eaede-34e2-49df-8cb3-4ebf327e9656 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:16.551893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1c7eaede-34e2-49df-8cb3-4ebf327e9656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:16.657643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 656/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:16.693765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:16.695456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:16.716135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:16.818985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb116-2260-4afc-bde7-2e6c5c36945f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:16.899650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:16.900314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:16.900594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:16.900868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:16.902523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:16.976918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:17.016651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:17.018106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11e83-fe4e-4f86-baab-16200c1756b1 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:17.037232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 669/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:19.085610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:19.086136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:19.086136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:19.087474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 657/1326] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:19.092891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc748ac-1d0f-414c-863d-aeb4e24c7374 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:19.093306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc748ac-1d0f-414c-863d-aeb4e24c7374 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:19.093455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc748ac-1d0f-414c-863d-aeb4e24c7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:19.160032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0cc748ac-1d0f-414c-863d-aeb4e24c7374 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:19.161273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0cc748ac-1d0f-414c-863d-aeb4e24c7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:19.264153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 670/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:19.299891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:19.301455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:19.364520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:19.410278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d5abc-25be-4145-973c-2334ec81412a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:19.485531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:19.486244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:19.486531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:19.486874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:19.488483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:19.608452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:19.611087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:19.612616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcc1e-cc9e-4d58-adcb-4fcc8e814451 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:19.631786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 658/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:21.698713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:21.699678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:21.699678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:21.701109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 671/1329] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:21.706452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9c5c-e75d-40cb-a6bb-8cd8bd959d04 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:21.706883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9c5c-e75d-40cb-a6bb-8cd8bd959d04 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:21.707076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9c5c-e75d-40cb-a6bb-8cd8bd959d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:21.775802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c19c9c5c-e75d-40cb-a6bb-8cd8bd959d04 None None] MFA Rules not processed for user `d433e7449d234a78ae97850207c8abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:21.777031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c19c9c5c-e75d-40cb-a6bb-8cd8bd959d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:21.884710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 659/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:21.922846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:21.924455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:21.956967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:22.029963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64580c3-4a0e-443c-99f4-eb3c859914cb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:22.108151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:22.108806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:22.109081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:22.109347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:22.111006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:22.190741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:22.224845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:22.226302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa4f94-76b9-40d8-a743-bea400d9e6e9 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:22.262889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 672/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:24.516327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:24.516874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:24.516874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:24.518253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 660/1332] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:24.524877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e250c-3f60-44d7-9b9a-8ac0c02472af None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:24.525308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e250c-3f60-44d7-9b9a-8ac0c02472af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:24.525457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e250c-3f60-44d7-9b9a-8ac0c02472af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:24.602356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd9e250c-3f60-44d7-9b9a-8ac0c02472af None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:24.603659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd9e250c-3f60-44d7-9b9a-8ac0c02472af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:24.708679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 673/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:24.748015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:24.750386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:24.833713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:24.875078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a76b89-c84d-48e1-ad2e-9733ffd1abe5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:24.949957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:24.950614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:24.950940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:24.951208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:24.952851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:25.075227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:25.076659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba5a0-1cae-4ac9-b669-6648c9ca7927 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:25.087982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:25.097527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 661/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:27.126017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:27.126991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:27.126991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:27.129131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 674/1335] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:27.139649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4940-bbb2-4e8a-a16f-273c399ab92c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:27.140467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4940-bbb2-4e8a-a16f-273c399ab92c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:27.141305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4940-bbb2-4e8a-a16f-273c399ab92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:27.233498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a95c4940-bbb2-4e8a-a16f-273c399ab92c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:27.235403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a95c4940-bbb2-4e8a-a16f-273c399ab92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:27.348249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 662/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:27.390424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:27.391991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:27.436701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:27.501113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ec50-2548-48ef-9903-7ac2f08270d6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:27.587134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:27.587799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:27.588080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:27.588354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:27.590021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:27.676360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:27.705958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:27.707451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec23a0-19cc-4da8-a82d-ebbccf65d073 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:27.726603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 675/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:30.050695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:30.051260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:30.051260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:30.053282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 663/1338] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:30.061292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3cec-e428-4867-9f35-006b959f9903 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:30.061677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3cec-e428-4867-9f35-006b959f9903 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:30.061862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3cec-e428-4867-9f35-006b959f9903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:30.130294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b7c3cec-e428-4867-9f35-006b959f9903 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:30.131523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b7c3cec-e428-4867-9f35-006b959f9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:30.230760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 676/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:30.266962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:30.268558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:30.347689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:30.379070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862f6e-5ed8-405b-b121-4291ddd8a5ef None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:30.462760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:30.463467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:30.463748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:30.464004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:30.465670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:30.586206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:30.587679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c94193-8a12-4656-a29a-47ee350a1fcf service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:30.606421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 664/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:34.558592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:34.559164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:34.559164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:34.560699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 677/1341] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:34.565955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f59d11-fb0e-47e4-b3e9-4aea60bbce79 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:34.566432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f59d11-fb0e-47e4-b3e9-4aea60bbce79 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:34.566527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f59d11-fb0e-47e4-b3e9-4aea60bbce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:34.570824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:34.632747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-81f59d11-fb0e-47e4-b3e9-4aea60bbce79 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:34.633961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-81f59d11-fb0e-47e4-b3e9-4aea60bbce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:34.731416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 665/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:34.770192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:34.771903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:34.824206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:34.881498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b20a4-05f1-4079-9862-ee1f78a12a05 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:34.955501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:34.956164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:34.956444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:34.956720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:34.958362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:35.055543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:35.072859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:35.074691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2826b11-0a7c-4d97-9ef7-10f1714cdf2b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:35.095111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 678/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:37.708938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:37.709539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:37.709539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:37.710982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 666/1344] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:37.717486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2203-a979-4102-b086-dfc92b15875c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:37.718079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2203-a979-4102-b086-dfc92b15875c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:37.718079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2203-a979-4102-b086-dfc92b15875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:37.794147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a1ee2203-a979-4102-b086-dfc92b15875c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:37.795431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a1ee2203-a979-4102-b086-dfc92b15875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:37.903856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 679/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:37.941635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:37.943249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:38.035837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:38.053527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9777-884c-4eae-aaa1-5aa7033a982d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:38.130105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:38.130916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:38.131198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:38.131472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:38.133167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:38.245536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:38.247100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93bb4b-db05-4f24-8da8-503f1b53a913 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:38.265707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 667/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:42.621567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:42.622102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:42.622102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:42.623512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 680/1347] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:42.629076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b049-ee21-4b3d-96d5-913ab309693e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:42.629649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b049-ee21-4b3d-96d5-913ab309693e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:42.629649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b049-ee21-4b3d-96d5-913ab309693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:42.645340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:42.702560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-44a0b049-ee21-4b3d-96d5-913ab309693e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:42.703831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44a0b049-ee21-4b3d-96d5-913ab309693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:42.806165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 668/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:42.852469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:42.854202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:42.911502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:42.965836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5fe2-61e8-41c7-bb7e-74c69c811626 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:43.045217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:43.045972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:43.046210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:43.046531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:43.048164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:43.157303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:43.161425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:43.163087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8994dd-cc16-4ccb-b5c1-7fdcbc23ab65 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:43.182499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 681/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:22:48.046991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf963d6-80b1-4291-a2e5-0e749bd4039d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:48.047433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf963d6-80b1-4291-a2e5-0e749bd4039d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:48.047692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf963d6-80b1-4291-a2e5-0e749bd4039d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:48.049413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 669/1350] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:48.054767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c0a5-422c-4392-923b-f4c9a05d647b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:48.055210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c0a5-422c-4392-923b-f4c9a05d647b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:48.055368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c0a5-422c-4392-923b-f4c9a05d647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:48.178881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8df1c0a5-422c-4392-923b-f4c9a05d647b None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:48.180126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8df1c0a5-422c-4392-923b-f4c9a05d647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:48.304002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 682/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:52.290905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93a89-3482-4e29-9926-876e0dd3343e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:52.291486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93a89-3482-4e29-9926-876e0dd3343e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:52.291486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93a89-3482-4e29-9926-876e0dd3343e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:52.293106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 670/1352] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:52.298880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609547-1023-4b55-a31d-fd4602fea488 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:52.299678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609547-1023-4b55-a31d-fd4602fea488 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:52.300260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609547-1023-4b55-a31d-fd4602fea488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:52.358665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:52.384261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-42609547-1023-4b55-a31d-fd4602fea488 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:52.386160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42609547-1023-4b55-a31d-fd4602fea488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:52.506126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 683/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:52.804099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=59 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:53.863690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e44e-dc76-478e-9c9b-b1a410c70822 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:53.864330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e44e-dc76-478e-9c9b-b1a410c70822 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:53.864330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e44e-dc76-478e-9c9b-b1a410c70822 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:53.865831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 671/1354] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:53.871085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8559ab-3bf1-4f97-9fe1-c1f7fb85a0e7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:53.871491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8559ab-3bf1-4f97-9fe1-c1f7fb85a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:53.871645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8559ab-3bf1-4f97-9fe1-c1f7fb85a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:53.948923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae8559ab-3bf1-4f97-9fe1-c1f7fb85a0e7 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:53.950396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae8559ab-3bf1-4f97-9fe1-c1f7fb85a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:53.994259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:54.062405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 684/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:22:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:57.557638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6f36-fd9a-47ab-beed-df68d42e2274 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:57.558225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6f36-fd9a-47ab-beed-df68d42e2274 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:57.558225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6f36-fd9a-47ab-beed-df68d42e2274 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:57.560467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 672/1356] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:57.568489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ff83-06da-4754-8456-cc5597dd52b5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:57.569329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ff83-06da-4754-8456-cc5597dd52b5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:57.569767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ff83-06da-4754-8456-cc5597dd52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:57.648102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f189ff83-06da-4754-8456-cc5597dd52b5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:57.649328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f189ff83-06da-4754-8456-cc5597dd52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:57.755428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 685/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:22:57.815734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:57.817031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:57.817626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:57.819984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 673/1358] 10.222.0.57 () {54 vars in 961 bytes} [Fri Jul 15 19:22:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:22:57.828616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5413-732f-4560-a5ff-9bde28af559d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:57.829489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5413-732f-4560-a5ff-9bde28af559d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:57.830593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5413-732f-4560-a5ff-9bde28af559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:57.851327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:57.917257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-215a5413-732f-4560-a5ff-9bde28af559d None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:22:57.918956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-215a5413-732f-4560-a5ff-9bde28af559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:58.047608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 686/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Jul 15 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:22:58.055290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:22:58.056807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:58.204011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f20d30-76b8-4898-a450-c21a9fdce13e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:22:58.280181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:22:58.324298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:22:58.324872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:22:58.325162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:22:58.325429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:22:58.327096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:22:58.421165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:22:58.422912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376b8c9-ebe9-4490-ae9c-f8c527698bfa service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:22:58.442084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 674/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:00.667274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:00.667958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:00.667958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:00.669439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 687/1361] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:00.674647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208a33-7045-42c0-a8ff-003acf3c68f2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:00.675145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208a33-7045-42c0-a8ff-003acf3c68f2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:00.675237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208a33-7045-42c0-a8ff-003acf3c68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:00.744941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b0208a33-7045-42c0-a8ff-003acf3c68f2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:00.746113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b0208a33-7045-42c0-a8ff-003acf3c68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:00.787233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:00.866873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 675/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:00.911289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:00.914525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:00.997752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:01.109186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e2ba6-9eeb-4da3-92ca-bf00759da44f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:01.229075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:01.229804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:01.230226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:01.230555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:01.232315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:01.257879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:01.332912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:01.334533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61615aeb-0705-4da7-9d51-d091dc484bdd service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:01.355460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 688/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:03.687195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f23542-719c-4c7a-a104-388834d0b351 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:03.688137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f23542-719c-4c7a-a104-388834d0b351 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:03.688604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f23542-719c-4c7a-a104-388834d0b351 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:03.690522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 676/1364] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:03.696371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb589c-0f85-4495-90d5-7c50c5544183 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:03.696869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb589c-0f85-4495-90d5-7c50c5544183 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:03.697119 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb589c-0f85-4495-90d5-7c50c5544183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:03.770467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1dbb589c-0f85-4495-90d5-7c50c5544183 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:03.771718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1dbb589c-0f85-4495-90d5-7c50c5544183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:03.882417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:03.890473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 689/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:03.930995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:03.931868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:03.932212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:03.933731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 677/1366] 10.222.0.57 () {54 vars in 961 bytes} [Fri Jul 15 19:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:03.940049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665401b-5a6e-4a66-bd30-1845d645c80c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:03.940331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665401b-5a6e-4a66-bd30-1845d645c80c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:03.940679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665401b-5a6e-4a66-bd30-1845d645c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:04.024550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5665401b-5a6e-4a66-bd30-1845d645c80c None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:04.025876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5665401b-5a6e-4a66-bd30-1845d645c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:04.147294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 690/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Jul 15 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:04.155541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:04.157109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:04.315517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a2d95-f5d9-4b59-8b04-15c9f8f77503 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:04.336795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:04.433437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:04.434203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:04.434548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:04.434936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:04.436660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:04.533716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:04.535379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5256d2c-2a1c-496d-93b2-d2fde39dae0c service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:04.554736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 678/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:05.521559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1588af-7ddb-4646-b3f1-ed9fe608fe1e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:05.522153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1588af-7ddb-4646-b3f1-ed9fe608fe1e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:05.522153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1588af-7ddb-4646-b3f1-ed9fe608fe1e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:05.523714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 691/1369] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:05.528937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ff98-2125-4054-b5a7-56f2a9622143 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:05.529365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ff98-2125-4054-b5a7-56f2a9622143 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:05.529482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ff98-2125-4054-b5a7-56f2a9622143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:05.560928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:05.613410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-fc68ff98-2125-4054-b5a7-56f2a9622143 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:05.614893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fc68ff98-2125-4054-b5a7-56f2a9622143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:05.718916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 679/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:06.072906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:06.073695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:06.073912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:06.075457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 692/1371] 10.222.0.57 () {54 vars in 963 bytes} [Fri Jul 15 19:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:06.080838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee39d-2cbc-42bf-8095-bdd13598247a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:06.080838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee39d-2cbc-42bf-8095-bdd13598247a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:06.080838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee39d-2cbc-42bf-8095-bdd13598247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:06.158744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-03eee39d-2cbc-42bf-8095-bdd13598247a None None] MFA Rules not processed for user `74a111fbdcd64c0fa65e2ecbd0fdc4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:06.160002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-03eee39d-2cbc-42bf-8095-bdd13598247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:06.208557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:06.241378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 680/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Fri Jul 15 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:06.249227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:06.250776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:06.307302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:06.371256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27e119-22a1-44c5-8266-0a4843cc2cb5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:06.450456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:06.451334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:06.451621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:06.451894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:06.453557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:06.557426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:06.571971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:06.573897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e343d9-2fcc-4947-a662-afd2d5276f5f service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:06.593750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 693/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:06.648487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:06.648941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:06.649416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:06.650981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 681/1374] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:06.656733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f072ff-d15f-4d87-84cb-19168dce7dc4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:06.657003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f072ff-d15f-4d87-84cb-19168dce7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:06.657254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f072ff-d15f-4d87-84cb-19168dce7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:06.725843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-99f072ff-d15f-4d87-84cb-19168dce7dc4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:06.727003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-99f072ff-d15f-4d87-84cb-19168dce7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:06.843374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 694/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:06.894557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:06.897212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:07.064724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8cd4-f657-4a65-8dd2-8a9f21a1393d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:07.117181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:07.180263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:07.180915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:07.181195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:07.181455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:07.183144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:07.284153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:07.285814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464270bc-9c5e-4ce6-ac2c-8ecbe6d7d04b service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:07.304330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 682/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:09.309532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:09.310090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:09.310090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:09.311514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 695/1377] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:09.317117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e487e-9d22-4dc0-83b2-f75fa45f596d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:09.317519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e487e-9d22-4dc0-83b2-f75fa45f596d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:09.317676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e487e-9d22-4dc0-83b2-f75fa45f596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:09.391050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bd8e487e-9d22-4dc0-83b2-f75fa45f596d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:09.392273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bd8e487e-9d22-4dc0-83b2-f75fa45f596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:09.399042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:09.514495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 683/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:09.564526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:09.566100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:09.629474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:09.718815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dce4-18db-46ea-8351-ee9d5fde46da None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:09.845427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:09.846087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:09.846364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:09.846634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:09.848311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:09.866474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:09.957248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:09.958924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972a93-0a30-4523-8777-9cc06d239876 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:09.993091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 696/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:12.044554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:12.045128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:12.045128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:12.047496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 684/1380] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:12.053484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a14b-9b94-4b1f-983e-f1e3816fa593 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:12.054102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a14b-9b94-4b1f-983e-f1e3816fa593 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:12.054102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a14b-9b94-4b1f-983e-f1e3816fa593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:12.124017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7711a14b-9b94-4b1f-983e-f1e3816fa593 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:12.125230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7711a14b-9b94-4b1f-983e-f1e3816fa593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:12.220878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:12.227874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 697/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:12.272509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:12.274186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:12.422435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:12.434202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac115fd-3274-4c9c-b2cd-efe8a177bced None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:12.559912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:12.560575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:12.560827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:12.561107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:12.563073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:12.662330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:12.663964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9e839-7e72-4ae7-98ab-62c807e4314e service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:12.674987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:12.685336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 685/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:14.854140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:14.855207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:14.855499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:14.857069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 698/1383] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:14.864050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35e6e-a454-4647-9352-e394f5cee140 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:14.864492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35e6e-a454-4647-9352-e394f5cee140 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:14.865072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35e6e-a454-4647-9352-e394f5cee140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:14.957372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-17d35e6e-a454-4647-9352-e394f5cee140 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:14.959319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-17d35e6e-a454-4647-9352-e394f5cee140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:15.067931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 686/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:15.113842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:15.115587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:15.272398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ec93-7657-496a-a0ea-662510601fa6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:15.351168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:15.399853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:15.400509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:15.400844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:15.401053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:15.402742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:15.499122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:15.500847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822d7d-1eb8-4024-b72f-2e476146b5ed service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:15.520913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 699/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:17.620201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:17.620917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:17.620917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:17.622309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 687/1386] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:23:17.629955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-729e-492a-becf-24eb2ccd6200 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:17.630409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-729e-492a-becf-24eb2ccd6200 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:17.630504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-729e-492a-becf-24eb2ccd6200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:17.713423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ce255b05-729e-492a-becf-24eb2ccd6200 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:17.715189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ce255b05-729e-492a-becf-24eb2ccd6200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:17.759840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:17.844895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 700/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:17.891844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:17.894024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:17.979146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:18.058010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6f65-e15b-467e-a641-165d7374358a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:18.180523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:18.181692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:18.182066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:18.182433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:18.184904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:18.249676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:18.320283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:18.322929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372d59-4a71-4395-8fce-c1584aa4a75e service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:18.350469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 688/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:20.381272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:20.381892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:20.381892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:20.383234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 701/1389] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:20.388455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538ea2-1de9-4961-b43a-8f68748818bc None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:20.388902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538ea2-1de9-4961-b43a-8f68748818bc None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:20.389029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538ea2-1de9-4961-b43a-8f68748818bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:20.458445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b0538ea2-1de9-4961-b43a-8f68748818bc None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:20.459701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b0538ea2-1de9-4961-b43a-8f68748818bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:20.563748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 689/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:20.607792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:20.609353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:20.762735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4915f4-c29b-439c-8bdd-fc32032bf8b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:20.781166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:20.880887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:20.881552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:20.881835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:20.882110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:20.883844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:20.974245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:20.975922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20c68e-c7db-4a24-b2e8-416224b2a8b7 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:20.994614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 702/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:21.585138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee905-378b-4b3b-8ee0-22661343c0f5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:21.585707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee905-378b-4b3b-8ee0-22661343c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:21.585707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee905-378b-4b3b-8ee0-22661343c0f5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:21.587148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 690/1392] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:21.592635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583834-3626-454c-8207-e5db0f9e32b2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:21.593080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583834-3626-454c-8207-e5db0f9e32b2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:21.593186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583834-3626-454c-8207-e5db0f9e32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:21.617998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:21.661355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f6583834-3626-454c-8207-e5db0f9e32b2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:21.662578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6583834-3626-454c-8207-e5db0f9e32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:21.763271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 703/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:23:21.824559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:21.824852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:21.825129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:21.826528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 691/1394] 10.222.0.57 () {54 vars in 960 bytes} [Fri Jul 15 19:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:21.832080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b93d-0c34-442c-856d-496f4e04def3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:21.832440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b93d-0c34-442c-856d-496f4e04def3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:21.832746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b93d-0c34-442c-856d-496f4e04def3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:21.910648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-73a0b93d-0c34-442c-856d-496f4e04def3 None None] MFA Rules not processed for user `94620d53b108470b9aebafcb5a8c38c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:21.911905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73a0b93d-0c34-442c-856d-496f4e04def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:21.953685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:21.991211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 704/1395] 10.222.0.57 () {58 vars in 1057 bytes} [Fri Jul 15 19:23:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:21.999078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:22.000600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:22.014402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:22.111680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db01aa-6f8b-491b-9c8a-fe1a1bd81ba5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:22.190328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:22.190920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:22.191198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:22.191473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:22.193124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:22.262584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:22.304596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:22.306090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9483d-046e-47df-b2c5-ae1a292270ad service glance] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:22.324703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 692/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:23.026357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f37fe-23be-4aa8-80cf-529af4858faf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.026858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f37fe-23be-4aa8-80cf-529af4858faf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.026965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f37fe-23be-4aa8-80cf-529af4858faf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.028427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 705/1397] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:23.033909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.034300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.034485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.037112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2468e-cffc-4140-a484-2f2880b9f509 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.037471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2468e-cffc-4140-a484-2f2880b9f509 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.037871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2468e-cffc-4140-a484-2f2880b9f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.102759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:23.104013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.104172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b7b2468e-cffc-4140-a484-2f2880b9f509 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:23.105331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b7b2468e-cffc-4140-a484-2f2880b9f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.193419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 706/1398] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:23:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:23:23.203364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 693/1399] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:23.241005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab43-24bb-4a3d-a11e-809d6f9defdd None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.241652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab43-24bb-4a3d-a11e-809d6f9defdd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.241776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab43-24bb-4a3d-a11e-809d6f9defdd None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.243460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 707/1400] 10.222.0.57 () {54 vars in 942 bytes} [Fri Jul 15 19:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:23.248271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:23.249605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.252940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.253267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.253513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.277172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:23.325329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:23.333560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] MFA Rules not processed for user `cbe289a5fd69404786a12a13e43bd697`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:23.334797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.364742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e63d3-3646-490e-b22d-32cb054ae346 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:23.444216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 708/1401] 10.222.0.57 () {58 vars in 1039 bytes} [Fri Jul 15 19:23:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:23.453783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:23.463300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2a5a7-6ccb-4751-b837-032bf47779d3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:23.482680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:23.483372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.483653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.483915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.485552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.504018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:23.571434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:23.572124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:23.572407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:23.572705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:23.574813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:23.577461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:23.578909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:23.580821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb69425-b730-42be-98fe-eb052e1b3908 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:23.599455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 694/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:23.662292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:23.663933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efa1ff-81f3-4a3b-8ad6-daf341256ce8 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:23.672784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 709/1403] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:23:25.625697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:25.626243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:25.626243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:25.629971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 695/1404] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:25.632766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc05c-abe7-4e25-80d4-b4a9a904a069 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:25.633190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc05c-abe7-4e25-80d4-b4a9a904a069 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:25.633337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc05c-abe7-4e25-80d4-b4a9a904a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:25.699742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-653bc05c-abe7-4e25-80d4-b4a9a904a069 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:25.700982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-653bc05c-abe7-4e25-80d4-b4a9a904a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:25.812120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:25.818836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 710/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:25.867603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:25.869187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:26.030443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:26.033020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ed6b-7610-463e-9f56-6c5a394e1029 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:26.163564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:26.164231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:26.164512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:26.164781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:26.166426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:26.282434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:26.284559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30bc9f-366f-43c0-b714-67485faacfdb service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:26.304018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 696/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:28.364237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:28.364811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:28.364811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:28.366147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 711/1407] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:28.371643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475c4d-63bd-4a1e-a458-b8278f882c20 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:28.372496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475c4d-63bd-4a1e-a458-b8278f882c20 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:28.372778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475c4d-63bd-4a1e-a458-b8278f882c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:28.376107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:28.446870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-67475c4d-63bd-4a1e-a458-b8278f882c20 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:28.448195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-67475c4d-63bd-4a1e-a458-b8278f882c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:28.557584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 697/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:28.608198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:28.609946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:28.782430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60194642-614f-4ff5-b80d-035bb885a41f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:28.865275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:28.915999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:28.916784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:28.917305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:28.917609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:28.919412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:29.018260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:29.019938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae4e0-56db-4451-ac31-41617e6d07b3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:29.043917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 712/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:38.555798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=64 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:39.038599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=64 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:45.788980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06d20-344a-4aee-ba8e-2699c3163cdd None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:45.789586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06d20-344a-4aee-ba8e-2699c3163cdd None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:45.789586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06d20-344a-4aee-ba8e-2699c3163cdd None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:45.791573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 698/1410] 10.222.0.57 () {54 vars in 918 bytes} [Fri Jul 15 19:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:45.796869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20f5b-26ff-4106-96e5-1325b4e30082 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:45.797323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20f5b-26ff-4106-96e5-1325b4e30082 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:45.797442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20f5b-26ff-4106-96e5-1325b4e30082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:45.872932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4bd20f5b-26ff-4106-96e5-1325b4e30082 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:45.874077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4bd20f5b-26ff-4106-96e5-1325b4e30082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:45.991890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 713/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Jul 15 19:23:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:46.007351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ceb8f-8204-4670-a79f-85a4bd492a9b None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:46.007633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ceb8f-8204-4670-a79f-85a4bd492a9b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:46.007903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ceb8f-8204-4670-a79f-85a4bd492a9b None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:46.009308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 699/1412] 10.222.0.57 () {54 vars in 918 bytes} [Fri Jul 15 19:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:46.014022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d117c-cc26-4cf9-aaf7-6c16d8d75c88 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:46.014337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d117c-cc26-4cf9-aaf7-6c16d8d75c88 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:46.014619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d117c-cc26-4cf9-aaf7-6c16d8d75c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:46.088639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:46.091721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-535d117c-cc26-4cf9-aaf7-6c16d8d75c88 None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:46.093523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-535d117c-cc26-4cf9-aaf7-6c16d8d75c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:46.221530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 714/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Jul 15 19:23:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:23:48.695278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:48.695862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:48.695862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:48.697173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:48.704205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13cae6-551d-43c9-8a35-459313bee845 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:48.704652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13cae6-551d-43c9-8a35-459313bee845 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:48.704748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13cae6-551d-43c9-8a35-459313bee845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:48.784783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca13cae6-551d-43c9-8a35-459313bee845 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:48.786021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca13cae6-551d-43c9-8a35-459313bee845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:48.843926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:48.888736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:48.936858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:48.939075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:49.097000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cc228-b03d-497e-8d32-c57ba377337e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:49.172767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:49.215707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:49.216371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:49.216645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:49.216915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:49.218634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:49.311572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:49.313178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd60adc-9a49-4a83-ba63-5f5f91781d67 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:49.332023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 701/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:50.234509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:50.235153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:50.235153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:50.236501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:23:50.242587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96075d7-2e9f-4cd6-bdec-26d7c06a5f15 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:50.243340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96075d7-2e9f-4cd6-bdec-26d7c06a5f15 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:50.243507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96075d7-2e9f-4cd6-bdec-26d7c06a5f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:50.328499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a96075d7-2e9f-4cd6-bdec-26d7c06a5f15 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:50.329746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a96075d7-2e9f-4cd6-bdec-26d7c06a5f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:50.357197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:50.428827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:50.581340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:50.583659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:50.736130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6bdf-7a13-4eba-96e2-7bc2ebc0fb46 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:50.780256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:50.861942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:50.862539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:50.862813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:50.863104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:50.864751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:50.958523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:50.960158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f3fe8-9dad-42ef-8f39-20fb39f773c2 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:50.979335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 717/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:51.858808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:51.859364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:51.859364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:51.860763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:51.866736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620e0-c149-4061-8f6d-463647b18a65 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:51.867476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620e0-c149-4061-8f6d-463647b18a65 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:51.867649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620e0-c149-4061-8f6d-463647b18a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:51.929656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:51.953256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43f620e0-c149-4061-8f6d-463647b18a65 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:51.954476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43f620e0-c149-4061-8f6d-463647b18a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:52.060218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:52.213776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:52.216234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:52.372857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a585e-7401-401e-8437-7e2756f1b27a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:52.385091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:52.493777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:52.494433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:52.494716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:52.495027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:52.496675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:52.606402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:52.608178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600f0a-0f0e-4543-a882-05d89212fd3c service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:52.627726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 704/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:53.481159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:53.482015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:53.482174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:53.484032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:53.489310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65dd3c-d77f-4e08-80ca-cd94a0faf5e6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:53.489727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65dd3c-d77f-4e08-80ca-cd94a0faf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:53.489872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65dd3c-d77f-4e08-80ca-cd94a0faf5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:53.509615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:53.570594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bf65dd3c-d77f-4e08-80ca-cd94a0faf5e6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:53.571855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bf65dd3c-d77f-4e08-80ca-cd94a0faf5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:53.688050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:53.838346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:53.840759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:53.955635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:53.994514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747ed4a-2c62-4a61-97c7-bd1b9dede679 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:54.124299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:54.124869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:54.125161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:54.125411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:54.127098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:54.207839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:54.222098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:54.223785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bebcab-1ab6-4c35-b42d-59dace74fac3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:54.241859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 720/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:55.122163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:55.123008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:55.123008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:55.125295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:55.131181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47708-958d-4724-a9ca-eabbcd182760 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:55.131655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47708-958d-4724-a9ca-eabbcd182760 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:55.131763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47708-958d-4724-a9ca-eabbcd182760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:55.337535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ea47708-958d-4724-a9ca-eabbcd182760 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:55.338743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ea47708-958d-4724-a9ca-eabbcd182760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:55.448126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:55.599021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:55.602165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:55.712052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:55.779209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e050-8ced-4c99-8a37-c95ed8abb787 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:55.913467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:55.914125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:55.914406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:55.914679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:55.916363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:55.966529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:56.010812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:56.012453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67450-4472-46e9-8a32-7371b80953d3 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:56.030982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 707/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:56.817965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:56.818409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:56.818528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:56.819925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:56.826831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c6c1-efe6-4b9f-82e9-92a5f2670575 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:56.827518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c6c1-efe6-4b9f-82e9-92a5f2670575 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:56.827614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c6c1-efe6-4b9f-82e9-92a5f2670575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:56.908283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f055c6c1-efe6-4b9f-82e9-92a5f2670575 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:56.909503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f055c6c1-efe6-4b9f-82e9-92a5f2670575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:57.011154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:57.164967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:57.167985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:57.226533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:57.335664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2040c-e897-4923-9d36-120792ca5782 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:57.456190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:57.456759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:57.457032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:57.457298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:57.459039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:57.466077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:57.557489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:57.559116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9be94-e04d-4ddb-b672-04d5f98017e3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:57.577717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 723/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:58.386297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:58.387380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:58.387380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:58.389523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:58.395653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4452-9b19-47c6-88c8-c1231dacfaf9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:58.396087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4452-9b19-47c6-88c8-c1231dacfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:58.396415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4452-9b19-47c6-88c8-c1231dacfaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:58.484143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cf3a4452-9b19-47c6-88c8-c1231dacfaf9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:23:58.485370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf3a4452-9b19-47c6-88c8-c1231dacfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:58.557982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:58.592494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:23:58.745489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:23:58.747790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:58.766141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:58.907748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79c914-fcc0-443c-826e-81d7db26d748 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:23:59.002875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:23:59.039832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:23:59.040495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:59.040777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:59.041051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:59.042744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:23:59.139897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:23:59.141518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a72f-d5d6-4a81-a641-36ae79bd453c service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:23:59.160393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 710/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:23:59.971491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:59.972343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:59.972343 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:23:59.974672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:23:59.979764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5e264-7832-48a1-91bf-07cd92e304a5 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:23:59.980216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5e264-7832-48a1-91bf-07cd92e304a5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:23:59.980323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5e264-7832-48a1-91bf-07cd92e304a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:00.059186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b2c5e264-7832-48a1-91bf-07cd92e304a5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:00.060319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b2c5e264-7832-48a1-91bf-07cd92e304a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:00.106059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:00.162227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:00.312064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:00.313541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:00.468784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd9879-01f7-445a-8a94-aee0cad17bf6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:00.528197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:00.592171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:00.592805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:00.593087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:00.593365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:00.595075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:00.694263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:00.695911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f2033-48e5-48b2-a352-8ab1cfbe281f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:00.716183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 726/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:01.509817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:01.510668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:01.510668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:01.513106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:01.519383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492991a-5a5f-46ca-a459-1cbc3ac22817 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:01.519974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492991a-5a5f-46ca-a459-1cbc3ac22817 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:01.520153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492991a-5a5f-46ca-a459-1cbc3ac22817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:01.605978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7492991a-5a5f-46ca-a459-1cbc3ac22817 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:01.607256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7492991a-5a5f-46ca-a459-1cbc3ac22817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:01.609381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:01.721428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:01.871101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:01.873607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:02.054538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eb20b-766b-486b-a0ab-cf999a2e0ba3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:02.085068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:02.176651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:02.177319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:02.177609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:02.177885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:02.179579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:02.275605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:02.277215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbe5c-5c04-4318-a8f9-34031b313809 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:02.296042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 713/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:04.211523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c521-a620-46da-a8dd-934509553507 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:04.212048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c521-a620-46da-a8dd-934509553507 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:04.212048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c521-a620-46da-a8dd-934509553507 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:04.213516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:04.219103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b919-5e57-4e4c-9ab0-2a16d5fa626a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:04.219544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b919-5e57-4e4c-9ab0-2a16d5fa626a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:04.219648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b919-5e57-4e4c-9ab0-2a16d5fa626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:04.261237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:04.287879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3769b919-5e57-4e4c-9ab0-2a16d5fa626a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:04.289105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3769b919-5e57-4e4c-9ab0-2a16d5fa626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:04.386910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:04.427953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c521-a620-46da-a8dd-934509553507 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:04.429503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa81c521-a620-46da-a8dd-934509553507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:04.549120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c521-a620-46da-a8dd-934509553507 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:04.584218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:04.628599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:04.629256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:04.629532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:04.629801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:04.631525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:04.744375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:04.745725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c29d-cff7-4c2f-87ec-73b58a31e549 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:04.764551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 729/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:24:06.953158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:06.953744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:06.953744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:06.955932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:06.961609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3bd8-57a2-4e01-a43b-ef8035c0bff8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:06.962053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3bd8-57a2-4e01-a43b-ef8035c0bff8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:06.962174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3bd8-57a2-4e01-a43b-ef8035c0bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:07.035431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a24c3bd8-57a2-4e01-a43b-ef8035c0bff8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:07.036650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a24c3bd8-57a2-4e01-a43b-ef8035c0bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:07.050135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:07.141203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:07.181499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:07.183114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:07.293698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdce4d6-24a0-43f1-89fb-c85ce94468c8 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:07.306656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:07.370067 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:07.370724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:07.371032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:07.371319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:07.372973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:07.499875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:07.501328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fb7ad-997e-4344-9cf1-5e5d98cf13b8 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:07.533570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 716/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:09.857694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:09.858281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:09.858281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:09.859731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:09.866171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df457-fa59-46da-9fa6-eac887e94bfe None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:09.866621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df457-fa59-46da-9fa6-eac887e94bfe None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:09.866904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df457-fa59-46da-9fa6-eac887e94bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:09.930999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:09.956212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3c2df457-fa59-46da-9fa6-eac887e94bfe None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:09.957460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3c2df457-fa59-46da-9fa6-eac887e94bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:10.068951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:10.111784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:10.114393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:10.230220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5953785-7439-405e-93ca-2f44277b1a4d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:10.277533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:10.313289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:10.313949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:10.314212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:10.314510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:10.316189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:10.435399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:10.436874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41cf70-f8c2-487a-be6d-5a974273a271 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:10.460287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 732/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:12.599338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:12.600208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:12.600208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:12.602519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:12.610444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5446-d699-4dc1-aab4-b3744956a96c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:12.610886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5446-d699-4dc1-aab4-b3744956a96c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:12.611030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5446-d699-4dc1-aab4-b3744956a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:12.679878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-993a5446-d699-4dc1-aab4-b3744956a96c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:12.681096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-993a5446-d699-4dc1-aab4-b3744956a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:12.703594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:12.786213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:12.824580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:12.826502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:12.956293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b18d-088c-4b3b-a9bd-1e1a90966195 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:12.977642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:13.034997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:13.035657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:13.035933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:13.036231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:13.037912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:13.159587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:13.161040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f09dd-d4f4-49a4-adbd-a77588dfd98e service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:13.179454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 719/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:15.248652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:15.249276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:15.249276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:15.250698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:15.260315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee297-b6db-4010-a499-844502e459d1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:15.261042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee297-b6db-4010-a499-844502e459d1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:15.261215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee297-b6db-4010-a499-844502e459d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:15.342875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:15.346171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-369ee297-b6db-4010-a499-844502e459d1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:15.348026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-369ee297-b6db-4010-a499-844502e459d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:15.466985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:15.520817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:15.523851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:15.643185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9712b58-aec6-473b-8de0-db014cab3b6f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:15.692361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:15.723130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:15.723787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:15.724083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:15.724362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:15.726023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:15.840979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:15.842436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ace6-69d5-424d-8813-b2bdf051de20 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:15.860463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 735/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:17.932888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:17.933499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:17.933499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:17.934839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:17.941756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4743da-f4f3-4fb1-bde9-12b2ee944983 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:17.942520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4743da-f4f3-4fb1-bde9-12b2ee944983 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:17.942692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4743da-f4f3-4fb1-bde9-12b2ee944983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:18.025315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4c4743da-f4f3-4fb1-bde9-12b2ee944983 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:18.026571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4c4743da-f4f3-4fb1-bde9-12b2ee944983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:18.057244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:18.126972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:18.168802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:18.171213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:18.284380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38dbd7-5612-4490-98eb-08660a2d6b56 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:18.313060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:18.365764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:18.366418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:18.366696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:18.367003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:18.368641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:18.499640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:18.501899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d672e7-8139-485b-98ba-6179ad9146f8 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:18.526050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 722/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:20.619699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:20.620599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:20.620599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:20.622874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:20.628505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0add9-1acb-4f20-8310-134ed0aa2a0a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:20.628955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0add9-1acb-4f20-8310-134ed0aa2a0a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:20.629058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0add9-1acb-4f20-8310-134ed0aa2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:20.704713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-89f0add9-1acb-4f20-8310-134ed0aa2a0a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:20.705933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-89f0add9-1acb-4f20-8310-134ed0aa2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:20.714647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:20.807390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:20.845564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:20.847160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:20.962268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425691f-a529-4b49-86dc-4b73173b3f67 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:21.024672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:21.044707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:21.045373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:21.045719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:21.045993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:21.047732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:21.159839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:21.161285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c9f9a-9be0-41c5-8176-ff51543fe4f3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:21.180200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 738/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:23.236565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:23.237153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:23.237153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:23.239337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:23.247520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54000a-3e1b-4116-b935-dbfaf55c8f24 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:23.247999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54000a-3e1b-4116-b935-dbfaf55c8f24 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:23.248112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54000a-3e1b-4116-b935-dbfaf55c8f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:23.321403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ba54000a-3e1b-4116-b935-dbfaf55c8f24 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:23.322649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba54000a-3e1b-4116-b935-dbfaf55c8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:23.372486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:23.433808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:24:23.475665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:23.478086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:23.608772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fb88-4c51-4481-9df0-4889df649114 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:23.648070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:23.688046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:23.688707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:23.688990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:23.689268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:23.690945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:23.818072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:23.819552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a444b-d390-46d5-8067-78a220d6ad0b service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:23.843583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 725/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:25.858244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:25.858857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:25.858857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:25.860232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:25.866744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f85d-26f8-4b78-937f-7ec3c4050972 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:25.867450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f85d-26f8-4b78-937f-7ec3c4050972 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:25.867774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f85d-26f8-4b78-937f-7ec3c4050972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:25.939404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-dec3f85d-26f8-4b78-937f-7ec3c4050972 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:25.940630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dec3f85d-26f8-4b78-937f-7ec3c4050972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:25.968757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:26.055465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:26.092522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:26.094157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:26.204819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a2ce-130f-4858-a82f-9894b6997f3f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:26.275840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:26.284886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:26.285546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:26.285821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:26.286087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:26.287780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:26.407546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:26.409005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553787b-5406-41a2-b27d-efc0825421c9 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:26.428147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 741/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:28.444211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:28.444829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:28.444829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:28.446900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:24:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:28.455988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f55c2c-22db-4d3f-87c5-12d65943b576 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:28.456414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f55c2c-22db-4d3f-87c5-12d65943b576 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:28.456572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f55c2c-22db-4d3f-87c5-12d65943b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:28.538878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-14f55c2c-22db-4d3f-87c5-12d65943b576 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:28.540109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-14f55c2c-22db-4d3f-87c5-12d65943b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:28.593559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:28.646275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:28.682978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:28.684537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:28.798235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d203b44-a670-4682-a153-de57f2410a84 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:28.848842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:28.885132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:28.885799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:28.886084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:28.886358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:28.888078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:29.019492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:29.020958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf6747-36cf-40ab-992a-3f8670568483 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:29.040426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 728/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:38.644427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=22 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:39.037762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=66 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:48.399046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff193-4b05-4b59-8b65-462cd77c642e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:48.399619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff193-4b05-4b59-8b65-462cd77c642e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:48.399619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff193-4b05-4b59-8b65-462cd77c642e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:48.401017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 743/1471] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:48.407612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d58da-4f32-4fad-8645-d02ce4dc9835 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:48.408372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d58da-4f32-4fad-8645-d02ce4dc9835 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:48.408550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d58da-4f32-4fad-8645-d02ce4dc9835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:48.488673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-153d58da-4f32-4fad-8645-d02ce4dc9835 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:48.489896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-153d58da-4f32-4fad-8645-d02ce4dc9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:48.591414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 729/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:48.646550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:48.646871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:48.647147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:48.648535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 744/1473] 10.222.0.57 () {54 vars in 960 bytes} [Fri Jul 15 19:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:48.653599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16ba0-1de7-488b-ae02-c9dd26da47ce None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:48.653826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16ba0-1de7-488b-ae02-c9dd26da47ce None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:48.654100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16ba0-1de7-488b-ae02-c9dd26da47ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:48.738381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-8da16ba0-1de7-488b-ae02-c9dd26da47ce None None] MFA Rules not processed for user `94620d53b108470b9aebafcb5a8c38c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:48.739654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8da16ba0-1de7-488b-ae02-c9dd26da47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:48.766758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:48.826260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 730/1474] 10.222.0.57 () {58 vars in 1057 bytes} [Fri Jul 15 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:48.834594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:48.836985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:48.956337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49535ae0-30dc-4604-8b46-5d6982c72376 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:49.029388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:49.030039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:49.030318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:49.030586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:49.032286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:49.097417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:49.155080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:49.156593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4480-5bbf-4491-b52c-19df0ebdf874 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:49.175627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 745/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:51.308463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:51.308938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:51.308938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:51.310387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 731/1476] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:51.316038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d183-a9cf-44a8-8233-0d7653c6ee9e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:51.316488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d183-a9cf-44a8-8233-0d7653c6ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:51.316597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d183-a9cf-44a8-8233-0d7653c6ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:51.386962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1888d183-a9cf-44a8-8233-0d7653c6ee9e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:51.388204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1888d183-a9cf-44a8-8233-0d7653c6ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:51.491390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 746/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:51.514379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:51.515981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:51.657199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f684d0-9271-4fb0-90be-2e3d5ceb22b6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:51.708298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:51.761855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:51.762530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:51.762825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:51.763115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:51.763856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:51.765689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:24:51.765689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:24:51.765689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:24:51.766923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e97d-d715-4c18-ad98-283bd4122e35 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:51.786937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 732/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Fri Jul 15 19:24:51 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:24:53.794369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:53.794985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:53.794985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:53.796333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 747/1479] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:53.804549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afe013-e782-448c-9de6-66f0c3b268d9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:53.804971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afe013-e782-448c-9de6-66f0c3b268d9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:53.805113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afe013-e782-448c-9de6-66f0c3b268d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:53.880248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f0afe013-e782-448c-9de6-66f0c3b268d9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:53.881517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f0afe013-e782-448c-9de6-66f0c3b268d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:53.989043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 733/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:54.040246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:54.041879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:54.052226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:54.209390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7eda-182e-48f0-a3eb-00f7ac421364 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:54.298181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:54.335071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:54.335655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:54.335936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:54.336217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:54.337859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:54.429773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:54.431404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169275f7-33db-4a6d-b2f4-8bf97b08c654 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:54.449671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 748/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:56.594817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:56.595414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:56.595414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:56.596750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 734/1482] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:56.603284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300cdf-252c-4d92-9c75-9cb56a3dd53f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:56.604045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300cdf-252c-4d92-9c75-9cb56a3dd53f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:56.604189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300cdf-252c-4d92-9c75-9cb56a3dd53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:56.678978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-65300cdf-252c-4d92-9c75-9cb56a3dd53f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:56.680199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-65300cdf-252c-4d92-9c75-9cb56a3dd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:56.728546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:56.783664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 749/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:56.819745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:56.821305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:56.847625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:56.932151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d627c6-5bb2-40e4-9974-bc2d4889a6fa None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:57.008156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:57.008799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:57.009074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:57.009345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:57.011089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:57.092106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:57.128706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:57.130113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5922a-dfdb-45aa-ba46-dce465307da0 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:57.148140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 735/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:24:59.194407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:59.195450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:59.195450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:59.197677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 750/1485] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:24:59.205415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe9d3-0804-4611-819e-2a7af40fcd25 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:59.205874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe9d3-0804-4611-819e-2a7af40fcd25 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:59.206228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe9d3-0804-4611-819e-2a7af40fcd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:59.275897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cb7fe9d3-0804-4611-819e-2a7af40fcd25 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:24:59.277172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cb7fe9d3-0804-4611-819e-2a7af40fcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:59.382006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 736/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:24:59.422649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:24:59.424309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:59.538836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8b620-e58d-4880-9ac3-ecba525f307e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:24:59.625069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:24:59.627348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:24:59.628043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:24:59.628327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:24:59.628604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:24:59.630817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:24:59.745449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:24:59.746950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cdf8c-c22a-4e57-9486-cd38f813a10b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:24:59.767058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 751/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:25:01.853422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:01.854244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:01.854244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:01.856558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 737/1488] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:25:01.864502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed9f4-9d11-4fce-b0b1-37627e668473 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:01.864958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed9f4-9d11-4fce-b0b1-37627e668473 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:01.865062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed9f4-9d11-4fce-b0b1-37627e668473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:01.933148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8aaed9f4-9d11-4fce-b0b1-37627e668473 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:25:01.934362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8aaed9f4-9d11-4fce-b0b1-37627e668473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:01.990540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:25:02.036104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 752/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:25:02.076394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:25:02.077907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:02.116085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:25:02.195875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7a74e-47c3-484f-9026-758ad57f3484 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:25:02.280243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:25:02.280911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:02.281193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:02.281511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:02.283227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:02.390475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:25:02.421506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:25:02.423079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f41b1-9835-4a79-a73d-e55125015925 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:25:02.442293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 738/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:25:04.679552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:04.680487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:04.680487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:04.682642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 753/1491] 10.222.0.57 () {54 vars in 926 bytes} [Fri Jul 15 19:25:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:25:04.688722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cdfe4-10db-4907-b085-29ad8181f392 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:04.689177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cdfe4-10db-4907-b085-29ad8181f392 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:04.689296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cdfe4-10db-4907-b085-29ad8181f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:04.756746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-972cdfe4-10db-4907-b085-29ad8181f392 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:25:04.758023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-972cdfe4-10db-4907-b085-29ad8181f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:04.860333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 739/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Fri Jul 15 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:25:04.902537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:25:04.904934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:05.026913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bb14-fc93-47b8-aa68-b6adb06de1b4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:25:05.111325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:25:05.112004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:25:05.112285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:25:05.112548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:25:05.114195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:25:05.123438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:25:05.239926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:25:05.241376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6b33-1ad7-4834-b269-54882b4aa428 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:25:05.259791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 754/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:25:14.858678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=82 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:25:15.257564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=50 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:53.327177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98368-ee11-496c-865a-6429ee753aed None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:53.328513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98368-ee11-496c-865a-6429ee753aed None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:53.328513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98368-ee11-496c-865a-6429ee753aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:53.415840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-dea98368-ee11-496c-865a-6429ee753aed None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:26:53.417075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dea98368-ee11-496c-865a-6429ee753aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:53.526825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 740/1494] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:26:53.536360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:53.537142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:53.537307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:53.617611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:26:53.618750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:53.719869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 755/1495] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:26:53.724828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98368-ee11-496c-865a-6429ee753aed None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:53.726062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dea98368-ee11-496c-865a-6429ee753aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:53.738092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98368-ee11-496c-865a-6429ee753aed None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:53.802889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:53.842047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:53.842731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:53.843092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:53.843370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:53.844091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:26:53.844403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:53.845423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:53.845423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:26:53.845423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:26:53.846332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:53.858568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 741/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:26:53.867997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:53.880334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ebb17-98e1-46ee-bdf8-fd4cee3a2d83 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:53.954954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:53.990987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:53.991656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:53.991939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:53.992218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:53.992894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:53.994653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:53.994653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:26:53.994653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:26:53.995880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:54.056004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 756/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:26:54.060353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:54.061946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:54.096184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5261-cc2b-466e-a0e5-69161a0d3710 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:54.191305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:54.191975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.192249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.192520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.193207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:54.194222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:54.194222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:26:54.194222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:26:54.195484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:54.244621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 742/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:26:54 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:26:54.249045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:54.250641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:54.313707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4deaf-bbb6-4e68-ad49-33e97f209673 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:54.398614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:54.410607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:54.411308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.411599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.411866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.412593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:54.413638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:54.413638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:26:54.413638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:26:54.414550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:54.427195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 757/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:26:54.431572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:54.433246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:54.444892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9480b8-2276-4cee-92b6-efd7c59bd3e4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:54.470994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:54.547517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:54.548193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.548471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.548738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.549464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:54.550483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:54.550483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:26:54.550483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:26:54.551402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a125-90ec-4b6e-b38a-bcfa74503554 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:54.564315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 743/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:26:54.568651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:54.570180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:54.605391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0803b-2393-45bb-a12b-148b572ccf55 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:54.713387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:54.714283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.714568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.714892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] PATH_INFO: `/v3/projects/fbd88af35eb6453dbc1800e9188dd0b5/users/06435bc5c0994c0bbd40441fa407057a/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.738030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd88af35eb6453dbc1800e9188dd0b5, user_id=06435bc5c0994c0bbd40441fa407057a, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:54.739128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:54.739128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:26:54.739128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:26:54.741032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31f02-4fec-4da2-a707-666284eac518 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:54.771088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 758/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:26:54 2022] PUT /identity/v3/projects/fbd88af35eb6453dbc1800e9188dd0b5/users/06435bc5c0994c0bbd40441fa407057a/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:26:54.783557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5897f5-038c-4768-beaa-e0707279344c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.783858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5897f5-038c-4768-beaa-e0707279344c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.784119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5897f5-038c-4768-beaa-e0707279344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.842753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-2f5897f5-038c-4768-beaa-e0707279344c None None] MFA Rules not processed for user `06435bc5c0994c0bbd40441fa407057a`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:26:54.843994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2f5897f5-038c-4768-beaa-e0707279344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:54.932145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 744/1502] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:26:54.945881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.946173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.946445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.947866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 759/1503] 10.222.0.57 () {54 vars in 963 bytes} [Fri Jul 15 19:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:26:54.953298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60ce-2351-49f6-9fb4-d26637372e6b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:54.953590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60ce-2351-49f6-9fb4-d26637372e6b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:54.953857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60ce-2351-49f6-9fb4-d26637372e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:54.985631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:55.156983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d03a60ce-2351-49f6-9fb4-d26637372e6b None None] MFA Rules not processed for user `74a111fbdcd64c0fa65e2ecbd0fdc4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:26:55.158238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d03a60ce-2351-49f6-9fb4-d26637372e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:55.256283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 745/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Fri Jul 15 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:26:55.264501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:55.266828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:55.323342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:55.380571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a00e60-3d4b-4366-80ea-d0f7fdaf64e8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:55.457705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:55.458366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:55.458649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:55.458964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:55.460620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:55.571325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:55.573155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:55.576893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:55.593136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 760/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:26:55.635386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db0c2d-8183-4187-acef-2846935114d3 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:55.635831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db0c2d-8183-4187-acef-2846935114d3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:55.635975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db0c2d-8183-4187-acef-2846935114d3 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:55.637380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 746/1506] 10.222.0.57 () {52 vars in 829 bytes} [Fri Jul 15 19:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:26:55.641167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:55.642420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:55.746631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eaf5e-9647-44f6-8c6a-fa50ed05bc86 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:55.846026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:55.846904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:55.847184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:55.847456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] PATH_INFO: `/v3/users/06435bc5c0994c0bbd40441fa407057a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:55.860591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06435bc5c0994c0bbd40441fa407057a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:55.861639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:55.861639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:26:55.861639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:26:55.862942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:55.872797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:55.927879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06435bc5c0994c0bbd40441fa407057a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:55.947171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06435bc5c0994c0bbd40441fa407057a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:55.947607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06435bc5c0994c0bbd40441fa407057a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:55.960594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06435bc5c0994c0bbd40441fa407057a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:55.961141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06435bc5c0994c0bbd40441fa407057a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:55.976922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 761/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:26:55 2022] DELETE /identity/v3/users/06435bc5c0994c0bbd40441fa407057a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:26:55.981535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:55.981844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:55.982148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:56.036063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:26:56.037274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:56.116532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:56.129228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 747/1508] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:26:56.139811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:56.141053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:56.247902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba38-ee54-4ea6-8cdd-a0d2c8b10c17 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:56.305895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:26:56.326647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:56.327339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:56.327991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:56.328267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:56.329928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:56.453139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:56.454603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ebdb-bf2c-4999-915f-8450d71d881e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:56.473463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 762/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:26:56.866976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:26:56.868488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:26:56.892204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bc500-90ba-454f-9789-47d54385a492 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:26:56.990310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:26:56.991142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:26:56.991419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:26:56.991671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] PATH_INFO: `/v3/projects/fbd88af35eb6453dbc1800e9188dd0b5` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:26:57.002309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd88af35eb6453dbc1800e9188dd0b5)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:26:57.003383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:26:57.003383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:26:57.003383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:26:57.004582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:26:57.064295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd88af35eb6453dbc1800e9188dd0b5', 'request_id': 'req-7b724504-4e82-4ca5-b5eb-28af48016ea7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:57.075753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd88af35eb6453dbc1800e9188dd0b5', 'request_id': 'req-7b724504-4e82-4ca5-b5eb-28af48016ea7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:57.090348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd88af35eb6453dbc1800e9188dd0b5', 'request_id': 'req-7b724504-4e82-4ca5-b5eb-28af48016ea7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:57.117356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] The token cache is being invalidate because project fbd88af35eb6453dbc1800e9188dd0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:26:57.117646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:57.118179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7b724504-4e82-4ca5-b5eb-28af48016ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:26:57.119605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 748/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:26:56 2022] DELETE /identity/v3/projects/fbd88af35eb6453dbc1800e9188dd0b5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:27:06.471102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=62 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:27:07.115138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:41.518918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:41.519528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:41.519528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:41.520873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:41.525971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d62-052b-4ec6-a39b-92e2e9d92f9c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:41.526418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d62-052b-4ec6-a39b-92e2e9d92f9c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:41.526521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d62-052b-4ec6-a39b-92e2e9d92f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:41.609457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-59e75d62-052b-4ec6-a39b-92e2e9d92f9c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:41.610657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-59e75d62-052b-4ec6-a39b-92e2e9d92f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:41.732319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:41.885767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:41.889606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:42.029352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3d9f1-81ba-4315-b361-bcb7d8a7e88f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:42.036396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:42.037067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:42.037383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:42.037651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:42.046990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:42.048594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97845-8a67-4ee2-8cc1-0ced0312cdce service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:42.062464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 764/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:42.893579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a761-9d4b-4cc8-bc3b-3006dbb205d9 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:42.894156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a761-9d4b-4cc8-bc3b-3006dbb205d9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:42.894156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a761-9d4b-4cc8-bc3b-3006dbb205d9 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:42.895587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:42.901669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446269a-0a6d-4bb0-a327-0a9752672b12 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:42.902137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446269a-0a6d-4bb0-a327-0a9752672b12 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:42.902248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446269a-0a6d-4bb0-a327-0a9752672b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:42.924639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d446269a-0a6d-4bb0-a327-0a9752672b12 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:42.925889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d446269a-0a6d-4bb0-a327-0a9752672b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:42.934364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:43.085983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a761-9d4b-4cc8-bc3b-3006dbb205d9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:43.111246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a761-9d4b-4cc8-bc3b-3006dbb205d9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:43.118187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:43.118870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.119158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.119421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.127897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:43.129504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f1ebb-2264-4ee3-820a-bb47410d9257 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:43.139240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 751/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:43.641101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc923cf-9bd8-4e71-8f2b-adfe3d92fce0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.641399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc923cf-9bd8-4e71-8f2b-adfe3d92fce0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.641704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc923cf-9bd8-4e71-8f2b-adfe3d92fce0 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.643135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 766/1517] 10.222.0.52 () {54 vars in 925 bytes} [Fri Jul 15 19:28:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:28:43.651669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407981b8-9d6d-4c14-802a-74fbf169dcf9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.651954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407981b8-9d6d-4c14-802a-74fbf169dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.652225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407981b8-9d6d-4c14-802a-74fbf169dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.716761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-407981b8-9d6d-4c14-802a-74fbf169dcf9 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:43.718167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-407981b8-9d6d-4c14-802a-74fbf169dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:43.740069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:43.801114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 752/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jul 15 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:52.919220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=56 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:52.975841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c67c0-a240-421b-8653-9fe873168829 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:52.975999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c67c0-a240-421b-8653-9fe873168829 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:52.976480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c67c0-a240-421b-8653-9fe873168829 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:52.978559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 767/1519] 10.222.0.57 () {54 vars in 960 bytes} [Fri Jul 15 19:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:52.985187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3dfe-0a1f-4138-bddc-8a8b0fd6e886 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:52.985636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3dfe-0a1f-4138-bddc-8a8b0fd6e886 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:52.985743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3dfe-0a1f-4138-bddc-8a8b0fd6e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:53.005527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-655a3dfe-0a1f-4138-bddc-8a8b0fd6e886 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:53.006602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-655a3dfe-0a1f-4138-bddc-8a8b0fd6e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:53.017043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 753/1520] 10.222.0.57 () {58 vars in 1057 bytes} [Fri Jul 15 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:53.024727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c67c0-a240-421b-8653-9fe873168829 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:53.040401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c67c0-a240-421b-8653-9fe873168829 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:53.046024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:53.046654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:53.046979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:53.047249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:53.055871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:53.057461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85547cf-60fd-4c03-9332-ab2dd42b342d service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:53.067304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 768/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:54.388453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462f96-cbcc-4561-a814-23348c88952f None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:54.389379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462f96-cbcc-4561-a814-23348c88952f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:54.389379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462f96-cbcc-4561-a814-23348c88952f None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:54.391705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:54.396762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3386a-8953-4243-a04d-189ef45dd336 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:54.397179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3386a-8953-4243-a04d-189ef45dd336 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:54.397297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3386a-8953-4243-a04d-189ef45dd336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:54.416110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7a3386a-8953-4243-a04d-189ef45dd336 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:54.417324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7a3386a-8953-4243-a04d-189ef45dd336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:54.426216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:54.586712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462f96-cbcc-4561-a814-23348c88952f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:54.608398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462f96-cbcc-4561-a814-23348c88952f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:54.614811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:54.615533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:54.615916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:54.616055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:54.624778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:54.626402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129ad62-9b14-482f-859f-0a614a0bfe94 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:54.636600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 755/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:55.447193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728119c-7d41-46a5-9765-b8a9f776b451 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:55.447614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728119c-7d41-46a5-9765-b8a9f776b451 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:55.447752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728119c-7d41-46a5-9765-b8a9f776b451 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:55.449206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:55.454805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd709cb-414c-4b2a-893e-ba4cee9081da None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:55.455270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd709cb-414c-4b2a-893e-ba4cee9081da None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:55.455384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd709cb-414c-4b2a-893e-ba4cee9081da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:55.475084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-dbd709cb-414c-4b2a-893e-ba4cee9081da None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:55.476274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dbd709cb-414c-4b2a-893e-ba4cee9081da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:55.484622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:28:55.641908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728119c-7d41-46a5-9765-b8a9f776b451 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:55.660101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728119c-7d41-46a5-9765-b8a9f776b451 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:55.666930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:55.667592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:55.667874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:55.668147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:55.677854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:55.679509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b3a4-aaa9-4848-8963-01162be2aaec service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:55.692913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 771/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:59.561750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:59.562713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:59.562713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:59.564869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:59.572863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c62-860b-4907-9385-5eb31ab1ffd5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:59.573309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c62-860b-4907-9385-5eb31ab1ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:59.573424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c62-860b-4907-9385-5eb31ab1ffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:59.597361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dcbe8c62-860b-4907-9385-5eb31ab1ffd5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:59.598610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dcbe8c62-860b-4907-9385-5eb31ab1ffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:59.608208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:28:59.647813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:59.649772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:59.743943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b2ec8-121e-4947-8d2b-1dc658ce9dfe None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:59.748084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:59.748784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:59.749040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:59.749316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:59.759957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:59.761411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa40c1b-b302-4304-a61c-23fc02d563be service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:59.771749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 758/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:01.769340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0836-cdf3-4bf8-8582-0911816d1c9e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:01.769924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0836-cdf3-4bf8-8582-0911816d1c9e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:01.769924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0836-cdf3-4bf8-8582-0911816d1c9e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:01.771345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:01.777771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc904-94ef-44d4-a03a-7b9738da89e1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:01.778546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc904-94ef-44d4-a03a-7b9738da89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:01.778702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc904-94ef-44d4-a03a-7b9738da89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:01.805278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ac0dc904-94ef-44d4-a03a-7b9738da89e1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:01.806488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ac0dc904-94ef-44d4-a03a-7b9738da89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:01.815373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:01.854354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af0836-cdf3-4bf8-8582-0911816d1c9e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:01.871498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af0836-cdf3-4bf8-8582-0911816d1c9e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:01.876412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:01.877093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:01.877374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:01.877647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:01.888096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:01.889561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a238b-38a2-4bf6-a288-69addfa0ec34 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:01.899766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 774/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:05.392468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:05.393094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:05.393094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:05.395213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:29:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:05.401276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70cc17-0d6d-45db-91a4-016a2f6af07b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:05.401761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70cc17-0d6d-45db-91a4-016a2f6af07b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:05.401863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70cc17-0d6d-45db-91a4-016a2f6af07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:05.420992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eb70cc17-0d6d-45db-91a4-016a2f6af07b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:05.422198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb70cc17-0d6d-45db-91a4-016a2f6af07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:05.431868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:05.746455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:05.749773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:05.833113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:05.848323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590779-b1a5-4359-b264-179bdaf2c879 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:05.852252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:05.852913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:05.853194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:05.853474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:05.863039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:05.864515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e114c-428d-4ddd-ab64-bd739fccbe12 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:05.874288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 761/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:07.920445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:07.921338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:07.921338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:07.923567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:29:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:07.929257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc9d8-5e2c-4179-a43a-1a6c54cafe88 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:07.929722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc9d8-5e2c-4179-a43a-1a6c54cafe88 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:07.929829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc9d8-5e2c-4179-a43a-1a6c54cafe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:07.949098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-95ecc9d8-5e2c-4179-a43a-1a6c54cafe88 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:07.950308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-95ecc9d8-5e2c-4179-a43a-1a6c54cafe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:07.959406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:08.282568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:08.284707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:08.298969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712359-a4a5-48d3-bffe-19243a8fe228 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:08.304014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:08.304647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:08.304929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:08.305199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:08.315770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:08.317236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b89b-4c52-460b-aaf7-f3dd58b9f1ef service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:08.327979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 777/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:17.944144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=11 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:18.323051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=33 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:47.249059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.250278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.250810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.279827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.281440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:47.295597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 763/1540] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:47.304393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.305364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.305856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.335127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.336728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:47.346859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 778/1541] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:47.351817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.362120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c5e3d-50fc-4df8-91a6-96292a167da6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.371161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.372139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.372637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.373122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.374055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:47.374573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.376431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.400986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 764/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:47.410738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.425398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525237-a4cc-4ecc-8308-fd23e8c3dc51 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.434571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.435578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.436042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.436495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.437408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.439672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a813e-e535-4a19-8e1a-55a0e7bf6760 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.509096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 779/1543] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:30:47.515370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.531127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3455c4-de58-411e-ad3f-87e02e54461c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.575367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f328-3eee-4faa-8b1a-c7b778737296 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.576065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f328-3eee-4faa-8b1a-c7b778737296 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.576561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f328-3eee-4faa-8b1a-c7b778737296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.611481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.612186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.612469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.612746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.616958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.616958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.618616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ea24f328-3eee-4faa-8b1a-c7b778737296 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.620151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ea24f328-3eee-4faa-8b1a-c7b778737296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:47.639820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 780/1544] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:47.649752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.650441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.655054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.657685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 765/1545] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:47.662343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.679291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82fdc2-fe65-4f85-b0ef-d13bfdb773bf admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.687898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.688696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.688992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.689257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.690000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.691652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.691853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.693376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:47.709295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 766/1546] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:30:47.709522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 781/1547] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:30:47.713227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.714810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.730342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e2124-370e-4cba-8304-b2997ad0b1a9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.730594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b37b6-0d64-4e4b-9285-b5e7ab8d928e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.745135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.745852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.746197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.746470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.747237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.748182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.748878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.749001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.749171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.749429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.750172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:47.750865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.751906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:30:47.751906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:30:47.751906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:30:47.752797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.782289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 767/1548] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:30:47.785383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 782/1549] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:47.787870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.793632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:47.812254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127ade-482d-4000-bb1c-9a0f1c011aad admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.815124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b901-df6b-4c0b-8355-b96cf0e840f7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:47.848043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.849163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.849688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.850204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.851251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.851469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:47.852416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.852703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.853083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] PATH_INFO: `/v3/projects/fb700c18f005484db8a76313ed60bfae/users/c22bd4ec11c84c3c9f036664d992585d/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.854362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c449-1a81-4970-8466-e794cb5195e1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.891008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb700c18f005484db8a76313ed60bfae, user_id=c22bd4ec11c84c3c9f036664d992585d, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:47.892190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:30:47.892190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:30:47.892190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:30:47.894344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d622bd-fce4-4bc9-a908-ab271166f4f2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:47.913312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 768/1550] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:47 2022] PUT /identity/v3/projects/fb700c18f005484db8a76313ed60bfae/users/c22bd4ec11c84c3c9f036664d992585d/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:47.915095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8449ca-7c02-4edb-9878-6151d1a0b076 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.915408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8449ca-7c02-4edb-9878-6151d1a0b076 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.915694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8449ca-7c02-4edb-9878-6151d1a0b076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.922457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 783/1551] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:30:47.928772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7305-bea1-462d-bf6f-02eec459b326 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:47.929057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7305-bea1-462d-bf6f-02eec459b326 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:47.929329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7305-bea1-462d-bf6f-02eec459b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:47.962520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9d8449ca-7c02-4edb-9878-6151d1a0b076 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.965911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9d8449ca-7c02-4edb-9878-6151d1a0b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:47.975715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e73c7305-bea1-462d-bf6f-02eec459b326 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:47.976948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e73c7305-bea1-462d-bf6f-02eec459b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.040578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 769/1552] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.041725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 784/1553] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.042162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85974-34c2-4b75-9ac6-7df95d16fdf0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.043223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.043516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.043788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.047086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85974-34c2-4b75-9ac6-7df95d16fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.047579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85974-34c2-4b75-9ac6-7df95d16fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.061428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.062626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.066530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a8c85974-34c2-4b75-9ac6-7df95d16fdf0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.067738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a8c85974-34c2-4b75-9ac6-7df95d16fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.070124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 785/1554] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.070960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.078828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 770/1555] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.078828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3496f9-da98-47ee-987e-8d85e6f99ab2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.078828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3496f9-da98-47ee-987e-8d85e6f99ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.078828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3496f9-da98-47ee-987e-8d85e6f99ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.083785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3f148-58ea-4734-b4a6-acb15c0e777a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.088325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.088998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.089308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.089631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.090303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.091382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:30:48.091382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:30:48.091382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:30:48.092585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6476c9-8f24-41b7-a39c-3744d123a216 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.104782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-0d3496f9-da98-47ee-987e-8d85e6f99ab2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.106159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0d3496f9-da98-47ee-987e-8d85e6f99ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.114664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 771/1556] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.115017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 786/1557] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.115947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b342f-866d-457e-98f5-befb8b87e063 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.116234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b342f-866d-457e-98f5-befb8b87e063 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.116423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80dc9-a34e-4462-ac78-bc54ca0d822c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.116524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b342f-866d-457e-98f5-befb8b87e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.116736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80dc9-a34e-4462-ac78-bc54ca0d822c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.116940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80dc9-a34e-4462-ac78-bc54ca0d822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.135083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f9a80dc9-a34e-4462-ac78-bc54ca0d822c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.136308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f9a80dc9-a34e-4462-ac78-bc54ca0d822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.137543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-191b342f-866d-457e-98f5-befb8b87e063 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.138702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-191b342f-866d-457e-98f5-befb8b87e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.144315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 787/1558] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.145519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.145802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.146074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.152796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 772/1559] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.154334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772659c-9618-461c-a584-32a8778873c0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.154614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772659c-9618-461c-a584-32a8778873c0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.154915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772659c-9618-461c-a584-32a8778873c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.162243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:48.166512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.167880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.174523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7772659c-9618-461c-a584-32a8778873c0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.175715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7772659c-9618-461c-a584-32a8778873c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.176059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 788/1560] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.176891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.183773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 773/1561] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.185014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7bf9-f6c3-49e6-852f-a360a21ba933 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.185393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7bf9-f6c3-49e6-852f-a360a21ba933 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.185573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7bf9-f6c3-49e6-852f-a360a21ba933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.203530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6e9a7bf9-f6c3-49e6-852f-a360a21ba933 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.204714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6e9a7bf9-f6c3-49e6-852f-a360a21ba933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.212403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 774/1562] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.213682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.213961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.214232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.230080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:48.231937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.233101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.242776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 775/1563] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.243637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.253377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b6227-aea4-47b6-82d7-2129bf701001 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.254114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f35b-c237-4668-bf77-7561cb5ba225 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.257829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.258498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.258774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.259258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.259614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.260299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.260582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.260839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.261610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.263249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f27807-b31a-4912-b615-35e346307994 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.270890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.272321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a775d54-7a8a-47cd-ac9f-e76c5249da99 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.273697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 776/1564] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:48.275004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.275252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.275574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.283172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 789/1565] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:48.284442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.284721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.284989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.299284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.300528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.303407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.304735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.311648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 777/1566] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.313179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.317804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 790/1567] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:48.318618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.324798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182a0cd-7492-498c-b13f-303499ba6620 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.329468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d8df1-c12e-4a2e-aa59-34beab51eace None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.330447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.331145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.331430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.331702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.332497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.332750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.334362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.334760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.335607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.335971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.336215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.336992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.337622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.338911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.349677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 778/1568] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.350932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.353078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 791/1569] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.354013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.363896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e645-8239-4d1b-99c5-75fce1ed3874 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.364899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752dce1-3e8e-4180-b984-2db35d38620f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.369075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.369648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.370102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.370338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.370618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.370731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.370974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.371281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.371714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.372065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.372184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.372605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.373879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.374401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.389659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 792/1570] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.389894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.398140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 779/1571] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.398140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.405221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9646d-5cfd-46d1-9765-079d741d42c4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.409345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0f0de-f976-47d9-8f1c-9cb3756741ef admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.409832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.410514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.410834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.411103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.411837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.413441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.414530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.415285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.415627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.415970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.416820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.417201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.419268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.424774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 793/1572] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:48.428826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.440292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 780/1573] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.440292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.440704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dc9a1-ad69-4615-ba2a-ee96d4567613 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.446165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.446484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d299f-cae9-4345-b42b-a49eb02cd5c1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.447471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.447867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.448205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.449255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:30:48.449674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.452698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.454504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.455354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.455670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.456465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.456757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.457826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:30:48.457826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:30:48.457826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:30:48.459274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.468764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 794/1574] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:30:48.469699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.480014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e00d-2a94-43e8-99ad-f0a2e2bca950 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.485762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.486448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.486735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.487123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.487756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.489892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.495656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 781/1575] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.496474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.525409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 795/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.526489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.564435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619a49-81f5-43c8-b51a-f810e6f22fbe admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.600559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1cc4-78d3-4bea-aee0-150606fb44eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.605815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.606642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.607177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.607349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.608127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.609969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.645789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 796/1577] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.646713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.650454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.651258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.651599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.651878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.652886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.655525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.680687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:48.694116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 782/1578] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 397 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.695422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.705318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:48.722043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba61c-f151-4105-9034-74b05ae3c2a9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.787874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da6865-cbea-45a0-ab8b-b2d242cf22e4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.795765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.796403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.796687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.796962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.797760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.799891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.827759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.828619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.828898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.829172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] PATH_INFO: `/v3/projects/6c1d5deefba84d1d9859a8126e29e57b/users/02ceb5c029cf43db9262dc3e61f7befb/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.832786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 783/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.832786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.848914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1d5deefba84d1d9859a8126e29e57b, user_id=02ceb5c029cf43db9262dc3e61f7befb, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.851742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.872730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 797/1580] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:48 2022] PUT /identity/v3/projects/6c1d5deefba84d1d9859a8126e29e57b/users/02ceb5c029cf43db9262dc3e61f7befb/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:48.879611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.923915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e871cb8-09dd-49ca-9c8c-cdba45640145 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.943980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded413b-b2f1-4189-b37e-7e499413b342 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.949647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.950406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.950806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.951188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.952369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.954650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:48.981770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 798/1581] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:48.983590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:48.990638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:48.991405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.991746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.992090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.993155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:48.994286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276864-f352-49c5-b426-e93ebdb0685d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:48.995282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.000025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.001323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.001609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.001883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.002747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.004747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.028766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 799/1582] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.029975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.034151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 784/1583] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.035730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.046601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc56-3807-4eb5-91f0-9df82f94738d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.057283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:49.111131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:49.114600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659aa8d-92cf-4f9a-8e78-4670d6276f31 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.119879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.120647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.121085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.121463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.122329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.124729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.127915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.128741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.129906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.130050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.130858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.133178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4935-bafe-48fc-85c8-fc386f8c9a6c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.152063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 785/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.153178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.162122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 800/1585] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.163767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.163975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.164362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.170293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4613-b134-44b7-a633-6a24e5f77905 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.176951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.177947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.178230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.178588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.179248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.182356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.205394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] MFA Rules not processed for user `02ceb5c029cf43db9262dc3e61f7befb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:49.207122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:49.211433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 786/1586] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.212521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.228863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37bc47-a7ab-4d20-bb52-8d2c7d31e1f8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.236369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.237357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.237641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.237923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.239408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.241566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.256360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 787/1587] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.257476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.270817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb88d-00c0-4941-8fc6-22cb6f1fb9b5 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.276624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.277386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.277665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.277935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.278763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.280556 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.294600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 801/1588] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:49.295627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.302921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 788/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.303620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.314183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9899-5126-4dda-ae32-04bfa9414276 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.314690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea1af-6525-4bb5-a0b7-c46a9a43bb6b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.319622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.319845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.320356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.320780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.320905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.321088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.321380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.321683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.321792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.322357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.323384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.324548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.343486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 789/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.344331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.359982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 802/1591] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:49.361620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.370947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbead83-5837-44d9-99de-b689c962e8fc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.376033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ad06-25ad-462e-8e94-4bd21c6f063b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.377489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.378165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.378452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.378906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.379770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.381628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.393139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.393393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 790/1592] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.393980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.394351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.395010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.395422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.397160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.397288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.407585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20e9c-798c-41fb-ad90-acfd28354e8f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.413401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.413615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 803/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.414091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.414370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.414644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.415034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.415439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.417072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.431572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 791/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.431795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f0aa-4560-4683-bf50-6a4f5de00109 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.431897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.436242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.437619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.437980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.438328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.439472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.441958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc78c98-fc88-42e5-aafc-dee11c96c8e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.449790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597e0c-01f2-41a7-9429-9fbe545b2bd2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.457481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 804/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.457481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c181-b4b1-4a2f-a80a-e71a8b46fc4f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.457481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c181-b4b1-4a2f-a80a-e71a8b46fc4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.457481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c181-b4b1-4a2f-a80a-e71a8b46fc4f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.459097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 805/1596] 10.222.0.57 () {54 vars in 961 bytes} [Fri Jul 15 19:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:49.459188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4c181-b4b1-4a2f-a80a-e71a8b46fc4f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.465364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.466203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.466588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.467024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.467948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.469734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.474008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4c181-b4b1-4a2f-a80a-e71a8b46fc4f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.479945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.481020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.481495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.482013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.482981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.486731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 792/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.486731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.488673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.499958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd82ea-3ec6-41cd-b5b7-19dbbf8dc991 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.508441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 806/1598] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.511978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.512931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.513747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.514123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.514299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.517815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.520323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.528917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11802887-4631-4eb1-bd64-f223efd7ed1b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.535926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.535926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.535926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.535926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.536378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.537292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 793/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.537743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.538500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.549868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e393e9-3a52-47d7-95bc-d1e66645321c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.550834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 807/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.555607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.556018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143ac33-e197-4033-9684-261820543367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.557077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ac33-e197-4033-9684-261820543367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.557551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ac33-e197-4033-9684-261820543367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.557967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ac33-e197-4033-9684-261820543367 admin admin] PATH_INFO: `/v3/projects/6f658a8dac5b4469ba8528795304a004/users/bb1c4b49c3cb4fd8b45e4233f431b741/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.568128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67484e-65bd-4ed6-a291-38a6d7c4ebc9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.574867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.575792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143ac33-e197-4033-9684-261820543367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f658a8dac5b4469ba8528795304a004, user_id=bb1c4b49c3cb4fd8b45e4233f431b741, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.576102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.577472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.577781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] PATH_INFO: `/v3/projects/9005994e857447be8b490a55133408b6/users/e94b74612bba421488bb811eb408bc77/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.580372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143ac33-e197-4033-9684-261820543367 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.599421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9005994e857447be8b490a55133408b6, user_id=e94b74612bba421488bb811eb408bc77, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.602274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.606409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 794/1601] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:49 2022] PUT /identity/v3/projects/6f658a8dac5b4469ba8528795304a004/users/bb1c4b49c3cb4fd8b45e4233f431b741/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:49.607536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.607827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.608108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.624830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 808/1602] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:49 2022] PUT /identity/v3/projects/9005994e857447be8b490a55133408b6/users/e94b74612bba421488bb811eb408bc77/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:49.626088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.671843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:49.674267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:49.696529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:49.722806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:49.733754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87209b-39a5-400e-a0e3-1fb3458afd6a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.738750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.739700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.739984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.740260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] PATH_INFO: `/v3/projects/dea51ed64de64e5687dae285dd312fc2/users/aa200bfc2dfe47ec9db51cecd1153422/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.761124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea51ed64de64e5687dae285dd312fc2, user_id=aa200bfc2dfe47ec9db51cecd1153422, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.764961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.787550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 809/1603] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:49 2022] PUT /identity/v3/projects/dea51ed64de64e5687dae285dd312fc2/users/aa200bfc2dfe47ec9db51cecd1153422/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:49.788782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.790089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 795/1604] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:49.791129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.804537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622eee8-2517-444d-ad1b-e3f8d8a201eb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.884285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.885212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.885498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.885774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] PATH_INFO: `/v3/projects/27f005d63306433698360c303e0d87e2/users/4844f8a778694b3cba8a424f9c2189c8/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.889074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3944-0280-41ef-9fe4-4eed620caa45 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.911248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.911958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.920943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.921156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f005d63306433698360c303e0d87e2, user_id=4844f8a778694b3cba8a424f9c2189c8, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.921435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.921435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.921624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403c23-fbb0-42b4-ad64-9eed7fe48cbc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.921705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.931930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 810/1605] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:49.932954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.952684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883236c-7fba-43f3-a1ac-df612c9402cc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.957915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 796/1606] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:49 2022] PUT /identity/v3/projects/27f005d63306433698360c303e0d87e2/users/4844f8a778694b3cba8a424f9c2189c8/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:49.959240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f9ce-d72f-4147-826f-181e686eb870 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.959715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f9ce-d72f-4147-826f-181e686eb870 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.960053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f9ce-d72f-4147-826f-181e686eb870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.981500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f5f6f9ce-d72f-4147-826f-181e686eb870 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:49.983047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f5f6f9ce-d72f-4147-826f-181e686eb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.047858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.048780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.049422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.049699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] PATH_INFO: `/v3/projects/7167bacdd3df47d7b063fba7cf042afd/users/48b4223daa854dee846a0fd5518d1ff4/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.068611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7167bacdd3df47d7b063fba7cf042afd, user_id=48b4223daa854dee846a0fd5518d1ff4, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.071467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.075700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 797/1607] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.077541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0576-24e1-421c-8267-5e7ad0939992 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.077850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0576-24e1-421c-8267-5e7ad0939992 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.078185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0576-24e1-421c-8267-5e7ad0939992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.094969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 811/1608] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:49 2022] PUT /identity/v3/projects/7167bacdd3df47d7b063fba7cf042afd/users/48b4223daa854dee846a0fd5518d1ff4/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:50.096197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.109734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d14b0576-24e1-421c-8267-5e7ad0939992 None None] MFA Rules not processed for user `e94b74612bba421488bb811eb408bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:50.111111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d14b0576-24e1-421c-8267-5e7ad0939992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.243254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:50.245388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:50.245602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc48db-a468-471f-b23f-6b96f5829f7e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.245602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.245602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.246073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 798/1609] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.246073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69254eb-52a4-4e45-b943-01002ee0eb2f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.246073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69254eb-52a4-4e45-b943-01002ee0eb2f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.246073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69254eb-52a4-4e45-b943-01002ee0eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.246434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.246434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.283772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e69254eb-52a4-4e45-b943-01002ee0eb2f None None] MFA Rules not processed for user `aa200bfc2dfe47ec9db51cecd1153422`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:50.284377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e69254eb-52a4-4e45-b943-01002ee0eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.327044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.329532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.341064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 812/1610] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:50.341916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.369228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 799/1611] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.369228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23172-0a4a-4195-a4b3-37afaa4456fa None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.369228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23172-0a4a-4195-a4b3-37afaa4456fa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.369228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23172-0a4a-4195-a4b3-37afaa4456fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.385982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c9c23172-0a4a-4195-a4b3-37afaa4456fa None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:50.387399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c9c23172-0a4a-4195-a4b3-37afaa4456fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.411696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6d6da-d8ec-4e74-8fed-d79cf52f56e1 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.416388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.417399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.417711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.418156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] PATH_INFO: `/v3/projects/e0a9744536c246589d29fb6da893353c/users/59a76b6656854ed6a845a451dfcc0185/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.434046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a9744536c246589d29fb6da893353c, user_id=59a76b6656854ed6a845a451dfcc0185, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.436759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.456784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 813/1612] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:50 2022] PUT /identity/v3/projects/e0a9744536c246589d29fb6da893353c/users/59a76b6656854ed6a845a451dfcc0185/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:50.458948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 800/1613] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.460710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.461770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.462060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.462340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.489417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:50.493025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.543879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b1d5-eb6e-457b-a438-865dbcd08559 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.554673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.555835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.556439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.557114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.576299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 801/1614] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.578769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.593868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:50.600082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:50.655114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51777-5d99-402d-8ca5-181d694f2aba None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.659241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.659858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.659974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.660211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.660571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.661541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.682155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 814/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:50.683135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.693478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296e7f-76db-4457-97a9-3566813e9ead service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.699948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.700841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.701402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.702231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.703731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.706109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.728147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.729627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0bc0b-fcc8-4e8f-9304-63f114d4a514 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.741367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 802/1616] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:50.742912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.743204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.743485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.747093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 815/1617] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:50.747093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.768002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:50.769579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:50.833318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eb7b-cf18-46d4-8dda-bff0554e2bd5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.837018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.837850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.838135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.838408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.889210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 803/1618] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:50.890369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.906239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca46e4-3e78-4fa1-840b-bf150c8bff54 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.913690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.917195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.917637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.918610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.923129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.924949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d942-c7ad-4f15-b25e-c0a68c525e3e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.936933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 816/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:50.938331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2920-5d38-439d-b4ed-df1483a1c68f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.938752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2920-5d38-439d-b4ed-df1483a1c68f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.939223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2920-5d38-439d-b4ed-df1483a1c68f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.941697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 817/1620] 10.222.0.57 () {54 vars in 912 bytes} [Fri Jul 15 19:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:50.942420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2920-5d38-439d-b4ed-df1483a1c68f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.947835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.952157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.956943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2920-5d38-439d-b4ed-df1483a1c68f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:50.962448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:50.963203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:50.963482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:50.963752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:50.964444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:50.966889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f0b2d-d80f-4119-8ca6-afc43dcf7c58 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:50.985812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 804/1621] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:50.986591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:50.988352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:51.003091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 818/1622] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:50 2022] POST /identity/v3/users => generated 306 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:51.004347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.004631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.004905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.014273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e04c4-0d90-4c8d-bd71-66c5fe179b0e service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.019002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.020055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.020567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.021006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.038152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.040866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.052259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:51.053520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:51.057034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 805/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:51.058554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.090615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510786-ad7d-4f43-b256-08f84c9f0cfb service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.096599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:51.102444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.103176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.103457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.103737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.107560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.113104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.133252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 806/1624] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:51.137965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.151370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e978-4478-4962-9ce3-a2e86290cb16 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.160662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.172397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.172865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.173951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] PATH_INFO: `/v3/projects/d1efa0ea34e3453288c3198b72afbcb6/users/82e92cf94a9d48ed87e2c91e96ecdbca/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.191952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1efa0ea34e3453288c3198b72afbcb6, user_id=82e92cf94a9d48ed87e2c91e96ecdbca, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.195622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.212347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 819/1625] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:30:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:51.240226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 807/1626] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:51 2022] PUT /identity/v3/projects/d1efa0ea34e3453288c3198b72afbcb6/users/82e92cf94a9d48ed87e2c91e96ecdbca/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:51.243645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.246390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.252065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:51.395770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a4db-a2a7-4ef9-bebf-06c171dc65b7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.427849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15184-07ab-4835-bbef-583d660cb3bb admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.444732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.445486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.445771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.446142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.455278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.457163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.506369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 808/1627] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:51.509365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.548184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc162bb-371e-4426-9654-cfacac66defc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:51.565961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.569241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.571929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.572537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] PATH_INFO: `/v3/projects/d1efa0ea34e3453288c3198b72afbcb6/users/82e92cf94a9d48ed87e2c91e96ecdbca/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.575485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:51.576280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.576587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.577939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1efa0ea34e3453288c3198b72afbcb6, user_id=82e92cf94a9d48ed87e2c91e96ecdbca, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.580092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.587395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489296d-bb90-45d0-a928-fbd743d0c834 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.635960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 809/1628] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:51 2022] PUT /identity/v3/projects/d1efa0ea34e3453288c3198b72afbcb6/users/82e92cf94a9d48ed87e2c91e96ecdbca/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:51.640151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:51.640600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:51.643107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:51.713455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] MFA Rules not processed for user `82e92cf94a9d48ed87e2c91e96ecdbca`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:51.715000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:51.773503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:51.776185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:51.810993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 820/1629] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:30:51.956800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 810/1630] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:51.966176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:51.975587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09a26-19ee-4ee3-bf2b-026114175a55 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:52.002080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:52.114905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:52.115859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:52.118565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:52.119062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:52.143813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:52.146036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a87a99-e13e-4884-8900-de5e78b1543b service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:52.179356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 821/1631] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:52.315290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:52.334925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb092e9-4ae5-43b9-8a7e-2f3bb997bf7e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:52.344118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:52.344911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:52.345195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:52.345472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:52.522553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:52.524108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f58f-e592-41cb-a491-c1465815d5b2 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:52.541632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 811/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:53.559648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f510d-0738-4fc6-9196-69d80e18877c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:53.560263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f510d-0738-4fc6-9196-69d80e18877c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:53.560502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f510d-0738-4fc6-9196-69d80e18877c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:53.562348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 822/1633] 10.222.0.57 () {54 vars in 961 bytes} [Fri Jul 15 19:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:53.571976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618a04-ad7d-4355-ba2e-f6c5490590be None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:53.572461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618a04-ad7d-4355-ba2e-f6c5490590be None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:53.572770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618a04-ad7d-4355-ba2e-f6c5490590be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:53.619062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-72618a04-ad7d-4355-ba2e-f6c5490590be None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:53.622600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-72618a04-ad7d-4355-ba2e-f6c5490590be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:53.628720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:53.805884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 812/1634] 10.222.0.57 () {58 vars in 1058 bytes} [Fri Jul 15 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:53.806991 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9a07-1283-4833-9b6a-ed13295f7c8a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:53.807441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9a07-1283-4833-9b6a-ed13295f7c8a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:53.807841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9a07-1283-4833-9b6a-ed13295f7c8a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:53.809737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 823/1635] 10.222.0.57 () {54 vars in 912 bytes} [Fri Jul 15 19:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:30:53.816263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acca7-4820-45db-9c80-6ca3c4d32cec None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:53.817330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acca7-4820-45db-9c80-6ca3c4d32cec None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:53.817856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acca7-4820-45db-9c80-6ca3c4d32cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:53.892799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-627acca7-4820-45db-9c80-6ca3c4d32cec None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:53.894395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-627acca7-4820-45db-9c80-6ca3c4d32cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:53.927367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 813/1636] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:53.945874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9a07-1283-4833-9b6a-ed13295f7c8a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:53.969499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9a07-1283-4833-9b6a-ed13295f7c8a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:53.990460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:53.991180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:53.991531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:53.991898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:54.014381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:54.015965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:54.036931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 824/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:30:55.334916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21786-729a-41c8-ba04-5c9798fbba9c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:55.335579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21786-729a-41c8-ba04-5c9798fbba9c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:55.336129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21786-729a-41c8-ba04-5c9798fbba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:55.397530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-eee21786-729a-41c8-ba04-5c9798fbba9c None None] MFA Rules not processed for user `4844f8a778694b3cba8a424f9c2189c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:55.401008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-eee21786-729a-41c8-ba04-5c9798fbba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:55.550417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:55.555547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 814/1638] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:55.686818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:55.687104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:55.687386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:55.721044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3fb86-f04a-4084-b176-600b718c26ae service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:55.732380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:55.733081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:55.733367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:55.733650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:55.740214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:55.742840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:55.750265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] MFA Rules not processed for user `c22bd4ec11c84c3c9f036664d992585d`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:55.751535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:55.800701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 825/1639] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:30:55 2022] POST /identity/v3/projects => generated 405 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:30:55.804417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:55.912449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 815/1640] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:55.919709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:55.952594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3838-6010-43d7-b18c-250f6435cd06 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:55.955242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7333-aaa5-449e-87ea-42a7a8056756 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:55.964042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:55.964809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:55.965089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:55.965368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:55.966077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:55.968060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:55.976715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:56.019166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 826/1641] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:30:55 2022] POST /identity/v3/users => generated 309 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:30:56.020402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:56.039551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c639e-1b45-4d25-8697-6e29e4d2cc26 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:56.054930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:56.055634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:56.055934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:56.056195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:56.056947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:56.058698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:56.087583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 827/1642] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:56.089812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:56.094361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:56.095670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:56.096205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:56.096668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:56.102602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb79a9-9ca0-4743-94e7-5125ae2191b8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:56.118123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:56.119507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:56.119765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:56.120836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] PATH_INFO: `/v3/projects/6998b5e02c2547328de26076807e9ea7/users/9412f41c0dfc40a689925d614a0e0609/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:56.123722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:56.145797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6998b5e02c2547328de26076807e9ea7, user_id=9412f41c0dfc40a689925d614a0e0609, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:56.150908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:56.177779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 828/1643] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:56 2022] PUT /identity/v3/projects/6998b5e02c2547328de26076807e9ea7/users/9412f41c0dfc40a689925d614a0e0609/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:30:56.179105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:56.207275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:56.209821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:56.224265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 816/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:56.277904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654e92-0ae2-4b23-a10c-da2387e0186f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:56.284196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:56.285124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:56.285781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:56.286646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:56.288147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:56.290259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76439-1e87-494b-a0a1-7d4ca35100bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:56.327928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:56.338800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 829/1645] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:30:56.342142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670ebe-ee13-44b6-bd27-3f96ca5e1efc service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:56.350502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:56.355587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:56.356906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:56.357460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] PATH_INFO: `/v3/projects/6998b5e02c2547328de26076807e9ea7/users/9412f41c0dfc40a689925d614a0e0609/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:56.361874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6998b5e02c2547328de26076807e9ea7, user_id=9412f41c0dfc40a689925d614a0e0609, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:56.365024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:56.413680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 817/1646] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:30:56 2022] PUT /identity/v3/projects/6998b5e02c2547328de26076807e9ea7/users/9412f41c0dfc40a689925d614a0e0609/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:57.835907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623caa-4340-448a-956a-598ed3cb7797 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:57.836480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623caa-4340-448a-956a-598ed3cb7797 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:57.836480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623caa-4340-448a-956a-598ed3cb7797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:57.887634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae623caa-4340-448a-956a-598ed3cb7797 None None] MFA Rules not processed for user `9412f41c0dfc40a689925d614a0e0609`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:57.889141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae623caa-4340-448a-956a-598ed3cb7797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:58.022271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 830/1647] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:58.311208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:58.433794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8694c-7589-45ac-a010-82bb806d963c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:58.439961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:58.440870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:58.441937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:58.442353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] PATH_INFO: `/v3/users/aa200bfc2dfe47ec9db51cecd1153422` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:58.443881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa200bfc2dfe47ec9db51cecd1153422)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:58.445370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: WARNING py.warnings [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:30:58.445370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: warnings.warn(msg) Jul 15 19:30:58.445370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: Jul 15 19:30:58.446948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:58.537417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:58.558520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa200bfc2dfe47ec9db51cecd1153422'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:58.607198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa200bfc2dfe47ec9db51cecd1153422'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:58.608256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa200bfc2dfe47ec9db51cecd1153422'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:58.633393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa200bfc2dfe47ec9db51cecd1153422'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:58.634395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa200bfc2dfe47ec9db51cecd1153422'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:58.671126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 818/1648] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:30:58 2022] DELETE /identity/v3/users/aa200bfc2dfe47ec9db51cecd1153422 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:30:58.676173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:58.677018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:58.677721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:58.724935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:58.726517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:58.815513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:58.816979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:58.876990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 831/1649] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:58.933901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:58.936437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:58.963665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:59.021427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbd13-a0a8-4c63-9cbb-445235a2e27a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:59.035511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:59.037345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.038358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.038885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] PATH_INFO: `/v3/users/02ceb5c029cf43db9262dc3e61f7befb` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.041730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ceb5c029cf43db9262dc3e61f7befb)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:59.044533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:59.062735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141ee7-b38c-4606-92a2-4535d3dd7caa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:59.071852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:59.073546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.075853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.076470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.101891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:59.105957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382755c-a44b-4aa3-94d8-1d59228b6dcd service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:59.124560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 832/1650] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:59.141765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ceb5c029cf43db9262dc3e61f7befb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:59.158145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ceb5c029cf43db9262dc3e61f7befb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:59.159340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ceb5c029cf43db9262dc3e61f7befb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:59.167248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ceb5c029cf43db9262dc3e61f7befb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:59.168192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ceb5c029cf43db9262dc3e61f7befb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:30:59.196856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 819/1651] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:30:58 2022] DELETE /identity/v3/users/02ceb5c029cf43db9262dc3e61f7befb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:30:59.202413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28fdaa-eb04-497b-80cb-787508da9ae8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.202761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28fdaa-eb04-497b-80cb-787508da9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.203156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28fdaa-eb04-497b-80cb-787508da9ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.238555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2a28fdaa-eb04-497b-80cb-787508da9ae8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:59.240801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2a28fdaa-eb04-497b-80cb-787508da9ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:59.361277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 833/1652] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:59.394662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:59.401170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:59.501294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:59.591538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134c1e-2fe5-43bf-9792-957d848f87aa admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:59.598963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:59.601824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.602276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.603132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.625914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:59.627466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ebf58-380c-4b33-998f-d5b37226210c service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:59.681557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 820/1653] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:59.781792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10d16-8a8f-4106-b148-422f06161858 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.782094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10d16-8a8f-4106-b148-422f06161858 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.782368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10d16-8a8f-4106-b148-422f06161858 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.784081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 834/1654] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:59.864400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba6f2d-b352-4435-9008-e237cb03fd2f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:59.864552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba6f2d-b352-4435-9008-e237cb03fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:59.864797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba6f2d-b352-4435-9008-e237cb03fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:59.896442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-93ba6f2d-b352-4435-9008-e237cb03fd2f None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:59.898329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-93ba6f2d-b352-4435-9008-e237cb03fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:00.091386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 821/1655] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:30:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:00.262138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f55df-cf0c-4081-8d60-e2fb8529e205 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:00.263314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f55df-cf0c-4081-8d60-e2fb8529e205 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:00.263787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f55df-cf0c-4081-8d60-e2fb8529e205 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:00.265234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 835/1656] 10.222.0.57 () {54 vars in 960 bytes} [Fri Jul 15 19:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:00.271985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:00.271985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:00.271985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:00.308120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:00.309572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:00.333764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 822/1657] 10.222.0.57 () {58 vars in 1057 bytes} [Fri Jul 15 19:31:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:00.343017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f55df-cf0c-4081-8d60-e2fb8529e205 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:00.371224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f55df-cf0c-4081-8d60-e2fb8529e205 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:00.377049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:00.377925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:00.378362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:00.379085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:00.398448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:00.399578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:00.414990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 836/1658] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:01.027529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:01.029029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:01.066027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d414e8-e9f5-4e6a-b4c2-72f731109d38 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:01.074758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:01.075734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:01.076018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:01.076294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] PATH_INFO: `/v3/projects/dea51ed64de64e5687dae285dd312fc2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:01.084019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea51ed64de64e5687dae285dd312fc2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:01.086021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:01.208051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea51ed64de64e5687dae285dd312fc2', 'request_id': 'req-30e209c4-fb03-443d-b49c-930824d15663'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.248819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea51ed64de64e5687dae285dd312fc2', 'request_id': 'req-30e209c4-fb03-443d-b49c-930824d15663'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.260173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea51ed64de64e5687dae285dd312fc2', 'request_id': 'req-30e209c4-fb03-443d-b49c-930824d15663'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.294324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] The token cache is being invalidate because project dea51ed64de64e5687dae285dd312fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:01.294621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.303382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.307399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 823/1659] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:01 2022] DELETE /identity/v3/projects/dea51ed64de64e5687dae285dd312fc2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:01.311636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:01.331047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3ce0-8418-47cc-8e08-f1c3661f74c1 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:01.473117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:01.478547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:01.479010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:01.479376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] PATH_INFO: `/v3/users/82e92cf94a9d48ed87e2c91e96ecdbca` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:01.482969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e92cf94a9d48ed87e2c91e96ecdbca)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:01.487598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:01.611001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:01.643151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e92cf94a9d48ed87e2c91e96ecdbca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.677963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e92cf94a9d48ed87e2c91e96ecdbca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.678741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e92cf94a9d48ed87e2c91e96ecdbca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.690134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e92cf94a9d48ed87e2c91e96ecdbca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.691018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-257d1dd8-c5a6-4cdb-8500-2dd7177655d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e92cf94a9d48ed87e2c91e96ecdbca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:01.715704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 837/1660] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:01 2022] DELETE /identity/v3/users/82e92cf94a9d48ed87e2c91e96ecdbca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:02.521977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:02.523552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:02.547297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e209c4-fb03-443d-b49c-930824d15663 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:02.683610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:02.698364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:02.699855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:02.700566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:02.701051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] PATH_INFO: `/v3/users/e94b74612bba421488bb811eb408bc77` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:02.704170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94b74612bba421488bb811eb408bc77)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:02.706944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:02.805801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94b74612bba421488bb811eb408bc77'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:02.806294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460001-ca74-43b7-8e36-a9423faf067e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:02.806757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460001-ca74-43b7-8e36-a9423faf067e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:02.807415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460001-ca74-43b7-8e36-a9423faf067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:02.836299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94b74612bba421488bb811eb408bc77'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:02.841867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94b74612bba421488bb811eb408bc77'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:02.843815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-78460001-ca74-43b7-8e36-a9423faf067e None None] MFA Rules not processed for user `c22bd4ec11c84c3c9f036664d992585d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:02.845750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-78460001-ca74-43b7-8e36-a9423faf067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:02.851330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94b74612bba421488bb811eb408bc77'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:02.852926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a837cc45-9c4e-466d-84bd-fc20015ebab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94b74612bba421488bb811eb408bc77'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:02.879118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 824/1661] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:02 2022] DELETE /identity/v3/users/e94b74612bba421488bb811eb408bc77 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:02.883134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:02.883588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:02.883967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:02.918796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:02.921140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.017518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 838/1662] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:03.031313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 825/1663] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:03.032607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4721-ad84-4e07-9811-394fa86d3502 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.034035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4721-ad84-4e07-9811-394fa86d3502 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.035060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4721-ad84-4e07-9811-394fa86d3502 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.036779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 839/1664] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:31:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:03.118902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:03.120973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.144823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.145209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.145587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.195025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] MFA Rules not processed for user `0768be15edd043a6a24a14d023baff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:03.201476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.349694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7057d-ddb2-46ee-a81e-ab1286426dca None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:03.361184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:03.362077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.362428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.363697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.386640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:03.390462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:03.416834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 840/1665] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:03.418390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:03.419493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 826/1666] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:03.421182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.429859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:03.431777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.462634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e395c1c-9e92-4e5c-a971-18da6598b521 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:03.465194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dca1e-b403-4b19-afc9-dbf35b7c52b5 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:03.481885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:03.482760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:03.483757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.485038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.485533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.488894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.489432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] PATH_INFO: `/v3/projects/6c1d5deefba84d1d9859a8126e29e57b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.489875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] PATH_INFO: `/v3/users/4844f8a778694b3cba8a424f9c2189c8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.492411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1d5deefba84d1d9859a8126e29e57b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:03.493079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4844f8a778694b3cba8a424f9c2189c8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:03.494324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:31:03.494324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 15 19:31:03.494324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: Jul 15 19:31:03.497779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:03.498388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:03.513139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:03.640621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4844f8a778694b3cba8a424f9c2189c8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.670360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4844f8a778694b3cba8a424f9c2189c8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.672933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4844f8a778694b3cba8a424f9c2189c8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.677595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1d5deefba84d1d9859a8126e29e57b', 'request_id': 'req-001f5aab-36e8-4750-97dd-40baaacfddc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.681158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:03.689405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4844f8a778694b3cba8a424f9c2189c8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.690715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4844f8a778694b3cba8a424f9c2189c8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.704043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1d5deefba84d1d9859a8126e29e57b', 'request_id': 'req-001f5aab-36e8-4750-97dd-40baaacfddc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.713961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1d5deefba84d1d9859a8126e29e57b', 'request_id': 'req-001f5aab-36e8-4750-97dd-40baaacfddc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.741593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 827/1667] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:03 2022] DELETE /identity/v3/users/4844f8a778694b3cba8a424f9c2189c8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:03.742892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:03.744573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.776687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] The token cache is being invalidate because project 6c1d5deefba84d1d9859a8126e29e57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:03.779463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.781381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-001f5aab-36e8-4750-97dd-40baaacfddc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:03.786715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 841/1668] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:03 2022] DELETE /identity/v3/projects/6c1d5deefba84d1d9859a8126e29e57b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:03.791482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dc3f9-1d95-431e-9ba0-85808202aae5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:03.792665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dc3f9-1d95-431e-9ba0-85808202aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:03.792958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dc3f9-1d95-431e-9ba0-85808202aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:03.844801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fb6dc3f9-1d95-431e-9ba0-85808202aae5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:03.846057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fb6dc3f9-1d95-431e-9ba0-85808202aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:03.990930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e791a-aeb7-4b72-89ee-4c8ccddd18d9 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.014134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.014910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.015245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.015529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.019762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:04.066454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.079589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.087129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 842/1669] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:04.095179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.095464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.095741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.121507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 828/1670] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:04.137295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:04.138559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:04.152898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 843/1671] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:04.156969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.180226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee007ef-68c4-4d35-a904-c8aaada6baaf service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.195887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.196599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.196881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.197153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.198694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:04.198995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.200955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.244809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 829/1672] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:04.247608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.263297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776911b-4948-4177-81af-a0fc3f560403 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.273611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.274411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.274684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.274983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.275768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.281655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.355732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.395293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 844/1673] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:04 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:04.400192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a086-49b1-4377-9d8a-5ee4a19fad11 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.537042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.540184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.540634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.541678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.544006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.546345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.558826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:04.584502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 830/1674] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:04 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:04.589337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.606145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f82a3-3311-413b-b7ed-7e84b5248b89 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.622361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.624125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.624415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.624695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.625552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.640506 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.693288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 845/1675] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:04.697597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.721634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26ad43-b7fb-4941-b664-ada07f3a5958 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.756016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.758566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.764324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.764619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.766271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.768807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.826376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.827185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 831/1676] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:04.828434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:04.829570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:04.865597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed555eea-80d7-4faa-a9b8-df32e2a65fe9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.873483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.874458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.874670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ef7f-91cc-4ad1-a4f4-42120dbd363f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:04.874798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.875041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] PATH_INFO: `/v3/projects/d1efa0ea34e3453288c3198b72afbcb6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.877154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1efa0ea34e3453288c3198b72afbcb6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.881226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.893252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:04.894598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.894900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.895165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] PATH_INFO: `/v3/projects/2d213ace850c4b8c951f2942a61354c2/users/79cbe0378de147228e8b631c9f3c059b/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:04.929182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d213ace850c4b8c951f2942a61354c2, user_id=79cbe0378de147228e8b631c9f3c059b, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:04.933750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14057-19ff-48e8-affd-6bf7f41241d9 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:04.962665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 832/1677] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:04 2022] PUT /identity/v3/projects/2d213ace850c4b8c951f2942a61354c2/users/79cbe0378de147228e8b631c9f3c059b/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:04.977397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:04.981738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:04.983243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.028791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1efa0ea34e3453288c3198b72afbcb6', 'request_id': 'req-3a28758c-4822-453e-8ed2-471571022d1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:05.057825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1efa0ea34e3453288c3198b72afbcb6', 'request_id': 'req-3a28758c-4822-453e-8ed2-471571022d1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:05.064342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] MFA Rules not processed for user `79cbe0378de147228e8b631c9f3c059b`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:05.066013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.073249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1efa0ea34e3453288c3198b72afbcb6', 'request_id': 'req-3a28758c-4822-453e-8ed2-471571022d1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:05.099904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] The token cache is being invalidate because project d1efa0ea34e3453288c3198b72afbcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:05.100204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:05.101112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3a28758c-4822-453e-8ed2-471571022d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:05.108284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 846/1678] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:04 2022] DELETE /identity/v3/projects/d1efa0ea34e3453288c3198b72afbcb6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:05.116128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39574c0-5d91-42d9-8b17-67de552cc9f8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.116423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39574c0-5d91-42d9-8b17-67de552cc9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.116729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39574c0-5d91-42d9-8b17-67de552cc9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.155745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c39574c0-5d91-42d9-8b17-67de552cc9f8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:05.157171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c39574c0-5d91-42d9-8b17-67de552cc9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.208811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:05.260269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 833/1679] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:05.265245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.267845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.333518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 847/1680] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:05.336177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.336177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.336177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.373495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:05.374834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.386452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 848/1681] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:05.391706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.402704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a222d-7887-4660-9b95-2ba68f0fb84c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.411699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.412563 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.413591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.413591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.418094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:05.418524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.420522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.456102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6463-0058-45fe-9961-4de083fc6d8e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.466611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.467720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.468065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.468440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.468589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 849/1682] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:05.469736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.470748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.484589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29a7ce-1a74-46ac-9de8-fb73f1cbbe54 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.487794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125045-3231-4ecb-b52d-ad47db35b0c6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.501179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.502396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.502950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.503794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.504729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.507069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c648031-172d-4c13-8ad3-fbf05452202d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.537561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 834/1683] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/projects => generated 363 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:05.539958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c73d1b-f708-4d4f-addd-86da1d0077db None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.540604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c73d1b-f708-4d4f-addd-86da1d0077db None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.541032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c73d1b-f708-4d4f-addd-86da1d0077db None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.544080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 835/1684] 10.222.0.57 () {54 vars in 912 bytes} [Fri Jul 15 19:31:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:05.544965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c73d1b-f708-4d4f-addd-86da1d0077db None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.563508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 850/1685] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:05.570369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.570669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.571098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.622712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:05.624814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.629669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:05.703681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c73d1b-f708-4d4f-addd-86da1d0077db None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.740785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 851/1686] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:05.749580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.848294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.848797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.849098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.856454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.857843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.861144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.885872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037a45-d460-49cc-8ae5-6d3895cd20ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.891960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.892750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.893044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.893320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.894251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.896362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.902415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 836/1687] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/users => generated 288 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:05.912626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.920080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:05.934038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 852/1688] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:05 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:05.941440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:05.955071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffca90-9cb8-41eb-878d-e22e947cc10f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.957618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22085-c8ea-4354-9608-619370b2d7dd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:05.963049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.964224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.964754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.965224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.965845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:05.966524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:05.966727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.966974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:05.967256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:05.970024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.972126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:05.988093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:05.990306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:05.998726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 853/1689] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:06.000024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.027578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 837/1690] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:06.028283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.037067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94dee-fbda-4b72-a3de-3584af15f0b9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.046626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.050297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.050669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.051041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.057353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.061348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.068095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbd3e-88a3-4d1a-a9f1-35b8b3576619 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.084597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 854/1691] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:06.084795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.084900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.085601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.085871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.086105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:06.086385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] PATH_INFO: `/v3/projects/50ae7202bee24f40b34f6c6b726df247/users/d7411c1555a144bc8da79614adf534fc/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.133198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ae7202bee24f40b34f6c6b726df247, user_id=d7411c1555a144bc8da79614adf534fc, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.136035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.162111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 838/1692] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:06 2022] PUT /identity/v3/projects/50ae7202bee24f40b34f6c6b726df247/users/d7411c1555a144bc8da79614adf534fc/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:06.163007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.167297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7b4dd-c570-4988-8f7f-476586f058f3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.305031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582ace9-7391-4a7d-87e2-2d355e4219d1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.312284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.313030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.314570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.315277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.316290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.318475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.325611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.326915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.327206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.327483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] PATH_INFO: `/v3/projects/27f005d63306433698360c303e0d87e2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.338069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f005d63306433698360c303e0d87e2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.343394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.359826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 839/1693] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:06.360952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.402505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c5039-cace-4fd0-9ef0-4c8f2f23b32e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.416584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.417750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.418134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.418505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.431117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.433500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.457159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 840/1694] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:06.460144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.488767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1eab-0f3f-42fc-8158-5fcdbc87be6e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.539224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f005d63306433698360c303e0d87e2', 'request_id': 'req-a18d351a-0bdf-4053-91c9-a14ef4cd204f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:06.549511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:06.586865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f005d63306433698360c303e0d87e2', 'request_id': 'req-a18d351a-0bdf-4053-91c9-a14ef4cd204f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:06.641636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f005d63306433698360c303e0d87e2', 'request_id': 'req-a18d351a-0bdf-4053-91c9-a14ef4cd204f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:06.701314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] The token cache is being invalidate because project 27f005d63306433698360c303e0d87e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:06.702815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:06.707290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:06.713739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 855/1695] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:06 2022] DELETE /identity/v3/projects/27f005d63306433698360c303e0d87e2 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:06.717532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.719999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:06.818727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:06.822934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:06.823617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:06.824439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] PATH_INFO: `/v3/projects/867d0ef4c3634989875be8a3dc78607e/users/639f6f674d324ec691b16fd62d81de3c/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:06.887406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867d0ef4c3634989875be8a3dc78607e, user_id=639f6f674d324ec691b16fd62d81de3c, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:06.892982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:06.950975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d351a-0bdf-4053-91c9-a14ef4cd204f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:06.958050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 841/1696] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:06 2022] PUT /identity/v3/projects/867d0ef4c3634989875be8a3dc78607e/users/639f6f674d324ec691b16fd62d81de3c/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:06.959639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:06.962364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.071925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:07.192234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2b9f3-4b06-4f5a-b61a-a6c273f29c06 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:07.197774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:07.198761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.199174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.199461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] PATH_INFO: `/v3/users/9412f41c0dfc40a689925d614a0e0609` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.201094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9412f41c0dfc40a689925d614a0e0609)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:07.203949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:07.206417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:07.208048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.208905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.208905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] PATH_INFO: `/v3/projects/50ae7202bee24f40b34f6c6b726df247/users/d7411c1555a144bc8da79614adf534fc/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.212296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ae7202bee24f40b34f6c6b726df247, user_id=d7411c1555a144bc8da79614adf534fc, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:07.231033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2bbf-e0fd-4755-91fc-b45050f5f88d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:07.250617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 856/1697] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:06 2022] PUT /identity/v3/projects/50ae7202bee24f40b34f6c6b726df247/users/d7411c1555a144bc8da79614adf534fc/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:07.252265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9799e2-a7ec-4756-b418-f27ac78ceb26 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.252748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9799e2-a7ec-4756-b418-f27ac78ceb26 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.253166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9799e2-a7ec-4756-b418-f27ac78ceb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.325423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca9799e2-a7ec-4756-b418-f27ac78ceb26 None None] MFA Rules not processed for user `639f6f674d324ec691b16fd62d81de3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:07.329648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca9799e2-a7ec-4756-b418-f27ac78ceb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.358713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9412f41c0dfc40a689925d614a0e0609'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.393317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9412f41c0dfc40a689925d614a0e0609'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.394669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9412f41c0dfc40a689925d614a0e0609'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.412574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9412f41c0dfc40a689925d614a0e0609'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.413817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9412f41c0dfc40a689925d614a0e0609'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.456377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 842/1698] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:06 2022] DELETE /identity/v3/users/9412f41c0dfc40a689925d614a0e0609 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:07.457314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:07.458804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.510015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:07.569590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 857/1699] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:07.576215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.578700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.579294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.616335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e21d-52f6-4ed7-8d97-c98c447b28a6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:07.620685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:07.621592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.621965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.622280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] PATH_INFO: `/v3/projects/9005994e857447be8b490a55133408b6` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.624552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9005994e857447be8b490a55133408b6)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:07.628595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:07.663591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] MFA Rules not processed for user `bb1c4b49c3cb4fd8b45e4233f431b741`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:07.666363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.699672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9005994e857447be8b490a55133408b6', 'request_id': 'req-da494111-1867-4cf2-bd15-85499317c8ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.713862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9005994e857447be8b490a55133408b6', 'request_id': 'req-da494111-1867-4cf2-bd15-85499317c8ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.724406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9005994e857447be8b490a55133408b6', 'request_id': 'req-da494111-1867-4cf2-bd15-85499317c8ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.740181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] The token cache is being invalidate because project 9005994e857447be8b490a55133408b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:07.740520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.741442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-da494111-1867-4cf2-bd15-85499317c8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:07.747280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 843/1700] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:07 2022] DELETE /identity/v3/projects/9005994e857447be8b490a55133408b6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:07.747280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b620-77ae-45e2-a671-ad9764de4a23 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.747280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b620-77ae-45e2-a671-ad9764de4a23 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.747280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b620-77ae-45e2-a671-ad9764de4a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:07.787682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b687b620-77ae-45e2-a671-ad9764de4a23 None None] MFA Rules not processed for user `d7411c1555a144bc8da79614adf534fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:07.788940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b687b620-77ae-45e2-a671-ad9764de4a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.923962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 858/1701] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:07.924973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:07.935776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:07.971367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b93a-4bf4-4afa-80e4-617f947e3354 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:07.986535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 844/1702] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:07.992715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:07.993252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:07.993636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.043312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:08.044747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.048549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:08.126356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:08.128387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:08.129101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.129582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.130116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.130822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:08.134168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:08.195727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 859/1703] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:08.198520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:08.206380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.217685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 845/1704] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:08.217685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:08.220695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.399721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f60c1-d548-4136-8b9c-95fbfd399c8d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:08.415372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace16d-e776-4998-b4b6-b000e589366f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:08.426518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:08.427454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.427846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.428233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.554959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:08.560453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:08.575024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 860/1705] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:08.576138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:08.579927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.585572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:08.586267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.587423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.587707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.589767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.617125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:08.619622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:08.654388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 846/1706] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:08.655461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:08.806328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8018e51-f5ec-4c3c-bc29-3db04782cf60 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:08.817635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:08.818320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.818601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.818923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.822580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a6d5-a4bf-4a6a-abe5-3b46b1afebff service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:08.834632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:08.835662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.836082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.836500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.837409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:08.839824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae8f1-efcd-46a1-822e-a1266f00eb35 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:08.849467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:08.855893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:08.883192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 847/1707] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:08 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:08.884733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:08.885170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:08.886580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:08.942979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:08.945279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.964082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 848/1708] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:08.965297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:08.973278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:08.992973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:08.997588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.007730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2085-6d68-4e06-b386-4581935544f6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.027529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.030014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.030393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 861/1709] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:09.031465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.032743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.033160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] PATH_INFO: `/v3/projects/6998b5e02c2547328de26076807e9ea7` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.042971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6998b5e02c2547328de26076807e9ea7)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.045859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.068473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec913b-3c28-433b-abc6-d1d934ecb4f7 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.098674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.102446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.111876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.114997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.117114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.125682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.170221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 862/1710] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:09.172781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.215964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640454-5513-418e-a986-be27a7fc2989 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.254108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6998b5e02c2547328de26076807e9ea7', 'request_id': 'req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:09.285693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6998b5e02c2547328de26076807e9ea7', 'request_id': 'req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:09.294914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6998b5e02c2547328de26076807e9ea7', 'request_id': 'req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:09.339722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] The token cache is being invalidate because project 6998b5e02c2547328de26076807e9ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:09.340043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:09.345417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:09.359052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 849/1711] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:08 2022] DELETE /identity/v3/projects/6998b5e02c2547328de26076807e9ea7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:09.359688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.372086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.454000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.456069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.457132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.457666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.462656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:09.463310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.465353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b39e4-05e1-48c6-a93c-4ca189a0db54 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.489947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 863/1712] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:09.491840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ec1-7bd7-43c1-9ce6-f2bdc2d1da37 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.492329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ec1-7bd7-43c1-9ce6-f2bdc2d1da37 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.492983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ec1-7bd7-43c1-9ce6-f2bdc2d1da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.536251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-df243ec1-7bd7-43c1-9ce6-f2bdc2d1da37 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:09.536401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df243ec1-7bd7-43c1-9ce6-f2bdc2d1da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.552429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35f0f-d2b9-484f-9b61-8ce2d935f8d8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.563710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 864/1713] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:09.565452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5a0c-5b78-45ca-90fb-5b95f46b38d5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.567077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5a0c-5b78-45ca-90fb-5b95f46b38d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.567077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5a0c-5b78-45ca-90fb-5b95f46b38d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.567521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.568446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.568728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.569009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] PATH_INFO: `/v3/projects/025b63313d994c7db69a28d6d6afb960/users/463c648521634a32bd5b32a87e384137/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.618139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=025b63313d994c7db69a28d6d6afb960, user_id=463c648521634a32bd5b32a87e384137, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.621059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.656616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 850/1714] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:09 2022] PUT /identity/v3/projects/025b63313d994c7db69a28d6d6afb960/users/463c648521634a32bd5b32a87e384137/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:09.656616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.667084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-055a5a0c-5b78-45ca-90fb-5b95f46b38d5 None None] MFA Rules not processed for user `48b4223daa854dee846a0fd5518d1ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:09.667373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.668336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-055a5a0c-5b78-45ca-90fb-5b95f46b38d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.812102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322836-d212-4b0d-9f9a-b437a4cd5bbd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.813185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:09.820686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.822040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.822542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.822914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.824154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.826862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.837589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 865/1715] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:09.839281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68bdd-9bc2-402a-993a-33aa43b81d44 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.839755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68bdd-9bc2-402a-993a-33aa43b81d44 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.840175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68bdd-9bc2-402a-993a-33aa43b81d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.882212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 851/1716] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:09.883162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.902822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aca68bdd-9bc2-402a-993a-33aa43b81d44 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:09.907347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aca68bdd-9bc2-402a-993a-33aa43b81d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.930635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:10.013047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 866/1717] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:10.013047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.013047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.013047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.043167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] MFA Rules not processed for user `48b4223daa854dee846a0fd5518d1ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:10.045223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.070945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c556-4b69-449b-a097-0969c4a10881 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.095854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.096760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.097149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.097525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.099053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.100838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.131660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 852/1718] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:10.136216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.145732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 867/1719] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:10.147169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.165229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de8dd-da9b-49b8-bb60-03b87f470b57 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.169456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568236f3-08de-4e27-8f28-f8a82574c4db admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.177740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.178454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.178736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.179041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.180386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:10.180702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.182342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.186057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.186842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.187588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.188012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.189017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.190730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.233314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 868/1720] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:10.234016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.245319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.264178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 853/1721] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:10 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:10.265358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.275041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ef3e-1488-43c4-880c-e845511c5762 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.283767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.284847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.285236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.285646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] PATH_INFO: `/v3/users/79cbe0378de147228e8b631c9f3c059b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.287302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79cbe0378de147228e8b631c9f3c059b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.294030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.310753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8138-b475-4ce6-b0fd-f48f4e97b88e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.324015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.324936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.325223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.325510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] PATH_INFO: `/v3/projects/025b63313d994c7db69a28d6d6afb960/users/463c648521634a32bd5b32a87e384137/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.332142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025b63313d994c7db69a28d6d6afb960, user_id=463c648521634a32bd5b32a87e384137, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.339312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.389635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 854/1722] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:10 2022] PUT /identity/v3/projects/025b63313d994c7db69a28d6d6afb960/users/463c648521634a32bd5b32a87e384137/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:10.392157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.401635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.436987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79cbe0378de147228e8b631c9f3c059b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:10.483886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79cbe0378de147228e8b631c9f3c059b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:10.487989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79cbe0378de147228e8b631c9f3c059b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:10.520312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79cbe0378de147228e8b631c9f3c059b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:10.521701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79cbe0378de147228e8b631c9f3c059b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:10.551331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 869/1723] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:10 2022] DELETE /identity/v3/users/79cbe0378de147228e8b631c9f3c059b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:10.552153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.554264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.589976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00cd1-2315-432c-b302-e85efdae8769 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.591160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:10.654260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:10.683559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.684409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.684712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.685149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.687260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.690695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0ef6-0a6b-4ae6-8197-13b31625d785 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.696857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.697631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.697983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.698403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.700094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.702562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.757539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 870/1724] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:10 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:10.759098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:10.762079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.813024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.814676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c93535-5e72-4444-b2e9-5063a993423c service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:10.842726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 855/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:10.844327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.844953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.844953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.904468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] MFA Rules not processed for user `463c648521634a32bd5b32a87e384137`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:10.905695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:10.969816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54465a5-18ef-4546-8775-bd46ec334bd8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:10.976969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:10.977756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:10.978725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:10.979681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:10.981199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:10.997588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3a00-0e3c-464a-8dd1-5a8e1ed21acf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.017483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 871/1726] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:11.019656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.020017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.020366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.049579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:11.051698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.063873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 856/1727] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:11.064902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.071444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 872/1728] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:11.071444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.083353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e4dab-8015-4387-9043-a8bbfb26dc10 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.090569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.091396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.091749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.092095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.092910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.093134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6bee-eea8-4ea7-a980-aa677951b351 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.094852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.111329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.113292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.113735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.114162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.115059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.117003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 873/1729] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:11.117656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.118181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.128288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.168126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 857/1730] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:11 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:11.169224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.174656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.300224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:11.306694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac014c-d186-41b7-89be-cebf6841c131 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.315195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ebcea-91f7-46fe-94e0-d66507b6a91b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.318994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.319682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.320094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.320388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.333188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.333886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.334174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.334455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.343471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.362050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.363592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.387584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 858/1731] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:11.388481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.415782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75feaa2-4fb7-4e6d-881f-aad76173cab1 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.438093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.438957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.439239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.439514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] PATH_INFO: `/v3/projects/45a45c6af12c463a9b04b06f422fc05a/users/a938bdad8cb64343817b3c72e717075c/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.488842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:11.493626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a45c6af12c463a9b04b06f422fc05a, user_id=a938bdad8cb64343817b3c72e717075c, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.500335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.539307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 859/1732] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:11 2022] PUT /identity/v3/projects/45a45c6af12c463a9b04b06f422fc05a/users/a938bdad8cb64343817b3c72e717075c/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:11.544209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.556156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.562180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb087d8-1535-4ba3-968c-d614dd84f98a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.587035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 874/1733] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:11.591910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.592738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.593048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.663971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] MFA Rules not processed for user `59a76b6656854ed6a845a451dfcc0185`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:11.665332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.715958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d597e-2055-42f5-82e1-fa7fcb2a7906 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.725663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.726649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.728768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.729274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.730690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.732950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eb24e-58c7-4447-a0b0-d1ee81f34723 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.747177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 860/1734] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:11.748813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.749200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.749818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.794717 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] MFA Rules not processed for user `a938bdad8cb64343817b3c72e717075c`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:11.809551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:11.841371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 875/1735] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:11.842237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:11.875138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d43b-6b73-4441-8820-1f7b9c4d18ed None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:11.896783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:11.898505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.898806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.901177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:11.902220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:11.909599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b981f00-ad4c-49b4-9510-ee845728d0c9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:11.954924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 876/1736] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:11.963336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:11.963683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:11.963967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.024864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] MFA Rules not processed for user `59a76b6656854ed6a845a451dfcc0185`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:12.030968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.041197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 861/1737] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:12.044326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:12.055145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 877/1738] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:12.056077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:12.075611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd36a55-aa52-4153-bd72-b1a32905e0c1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:12.090283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:12.091487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.091774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.092052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] PATH_INFO: `/v3/projects/62bfa478ab954e63bc0914ca97b0fa46/users/a472bcce818c41e2ba8c9b641c4be3c5/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.099890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1711c-82d7-4c6e-af1b-8a28a3f8c314 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:12.121909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:12.122609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.126381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.126692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.127627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:12.133222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:12.142451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bfa478ab954e63bc0914ca97b0fa46, user_id=a472bcce818c41e2ba8c9b641c4be3c5, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:12.149447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:12.201150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 878/1739] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:12 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:12.202549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 862/1740] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:12 2022] PUT /identity/v3/projects/62bfa478ab954e63bc0914ca97b0fa46/users/a472bcce818c41e2ba8c9b641c4be3c5/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:12.204453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:12.219727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:12.227198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.345928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:12.403861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489f99b-0436-47a2-842c-7132b6457157 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:12.438725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:12.441161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.441366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.441636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.445884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489eec7-708e-4c49-b5d1-b45247bcfcc3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:12.517786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:12.608922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:12.609633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.613208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.613518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.614550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:12.616582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c27a09-ccd0-4ef2-9800-78cdbd8f2551 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:12.643235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:12.667388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868a32-1daf-4d29-931b-656750240cb1 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:12.679745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 863/1741] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:12 2022] POST /identity/v3/users => generated 296 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:12.697510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703be9b-9ccf-496a-aeb4-247db5dad054 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.700479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703be9b-9ccf-496a-aeb4-247db5dad054 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.701375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703be9b-9ccf-496a-aeb4-247db5dad054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.717854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 879/1742] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:12.719558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.723175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.723578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.801848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] MFA Rules not processed for user `bb1c4b49c3cb4fd8b45e4233f431b741`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:12.803118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.832055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e703be9b-9ccf-496a-aeb4-247db5dad054 None None] MFA Rules not processed for user `a472bcce818c41e2ba8c9b641c4be3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:12.836638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e703be9b-9ccf-496a-aeb4-247db5dad054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.976110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 880/1743] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:12.978905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.028357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb5b1-fdf1-435b-a9b2-63013985501a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:13.046435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 864/1744] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:13.047075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:13.047380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:13.049031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:13.049840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:13.050691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:13.055072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:13.062474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:13.063717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:13.082849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:13.115730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 881/1745] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:13.116966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.119481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.152738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbba47-a54d-4e8a-9a2a-4ace9b115875 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:13.165655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:13.168250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:13.168520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:13.168730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] PATH_INFO: `/v3/projects/2d213ace850c4b8c951f2942a61354c2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:13.172216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d213ace850c4b8c951f2942a61354c2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:13.174240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:13.201348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:13.205137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.287669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:13.312156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d213ace850c4b8c951f2942a61354c2', 'request_id': 'req-c6a90468-d405-485c-9bb0-9b8393e98c49'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:13.337246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d213ace850c4b8c951f2942a61354c2', 'request_id': 'req-c6a90468-d405-485c-9bb0-9b8393e98c49'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:13.345415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d213ace850c4b8c951f2942a61354c2', 'request_id': 'req-c6a90468-d405-485c-9bb0-9b8393e98c49'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:13.377823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] The token cache is being invalidate because project 2d213ace850c4b8c951f2942a61354c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:13.378435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:13.380738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:13.385549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 882/1746] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:13 2022] DELETE /identity/v3/projects/2d213ace850c4b8c951f2942a61354c2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:13.389783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.394538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.455559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 865/1747] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:13.457161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.465491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.534310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f074ea-88bd-437f-9cb1-28a720c455b0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:13.602157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:13.706050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90468-d405-485c-9bb0-9b8393e98c49 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:13.733935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:13.747859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:13.748314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:13.749881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:13.754512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:13.767362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:13.791087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:13.792588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:13.793358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:13.793788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] PATH_INFO: `/v3/projects/8089dacfd7ed49228c30502074d855d8/users/d5ff757b16974f0db4525f13cf8f8efe/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:13.818748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8089dacfd7ed49228c30502074d855d8, user_id=d5ff757b16974f0db4525f13cf8f8efe, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:13.829323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:13.859707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 866/1748] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:13 2022] PUT /identity/v3/projects/8089dacfd7ed49228c30502074d855d8/users/d5ff757b16974f0db4525f13cf8f8efe/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:13.861821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.864705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.919868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 883/1749] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:13 2022] POST /identity/v3/projects => generated 381 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:13.921043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:13.927869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:13.973374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dcbc5-e724-44e3-8fbf-f35bb0a686c7 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:14.114384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:14.125485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:14.127633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.128031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.128406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] PATH_INFO: `/v3/users/d7411c1555a144bc8da79614adf534fc` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.131597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7411c1555a144bc8da79614adf534fc)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:14.136205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:14.254056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b8d0d-8b82-4aa6-ab0d-f20782d5546e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:14.277097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7411c1555a144bc8da79614adf534fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:14.296035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:14.296993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.300457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.301025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.330236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7411c1555a144bc8da79614adf534fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:14.332542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7411c1555a144bc8da79614adf534fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:14.348485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7411c1555a144bc8da79614adf534fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:14.365229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7411c1555a144bc8da79614adf534fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:14.407157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 867/1750] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:13 2022] DELETE /identity/v3/users/d7411c1555a144bc8da79614adf534fc => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:14.408200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:14.410362 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:14.537561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:14.539282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:14.561261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 884/1751] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:31:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:31:14.562146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:14.594288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c192b9f-b740-48b6-a91b-2bb48e464488 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:14.678838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b60d-95aa-4403-b016-857b2a10596a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:14.698995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:14.699861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.700061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.700350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.701114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:14.715512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:14.753068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 868/1752] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:14.766835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:14.793447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:14.821542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72212-f3ab-4ecb-beb8-00f7b5810fee admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:14.853402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:14.854429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.854806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.855083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] PATH_INFO: `/v3/projects/8089dacfd7ed49228c30502074d855d8/users/d5ff757b16974f0db4525f13cf8f8efe/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.860298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8089dacfd7ed49228c30502074d855d8, user_id=d5ff757b16974f0db4525f13cf8f8efe, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:14.863202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0996943-452a-494d-a27c-34d58bfdb64c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:14.864519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:14.868990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.869395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.869706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.879484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:14.885516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:14.929652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 869/1753] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:14 2022] PUT /identity/v3/projects/8089dacfd7ed49228c30502074d855d8/users/d5ff757b16974f0db4525f13cf8f8efe/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:14.941262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.941789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.942274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.982937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 885/1754] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:14 2022] POST /identity/v3/users => generated 297 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:14.986909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:14.993391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:15.041208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] MFA Rules not processed for user `d5ff757b16974f0db4525f13cf8f8efe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:15.045922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:15.046174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934422-ebd1-4000-8a81-c375acbb46ff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:15.169075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:15.244412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 870/1755] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:15.263486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:15.265516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:15.374291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:15.377026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.377778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.378656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:15.382692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:15.390475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:15.418587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 886/1756] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:15.419741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:15.423214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:15.479159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6aa6-13e3-4258-9bfe-f3ff81c75dc4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:15.502890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:15.519057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.523711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.527632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] PATH_INFO: `/v3/projects/50ae7202bee24f40b34f6c6b726df247` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:15.535733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ae7202bee24f40b34f6c6b726df247)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:15.544738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:15.664041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe003115-223d-4e52-8647-31f3367ee76e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:15.683512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:15.696974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.697874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.698711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:15.740984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:15.745134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:15.827425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 871/1757] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:15.829736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:15.830827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ae7202bee24f40b34f6c6b726df247', 'request_id': 'req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:15.858854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ae7202bee24f40b34f6c6b726df247', 'request_id': 'req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:15.869976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ae7202bee24f40b34f6c6b726df247', 'request_id': 'req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:15.872962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873b3c-3d2b-43f3-ad23-4552c01de2a9 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:15.916301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] The token cache is being invalidate because project 50ae7202bee24f40b34f6c6b726df247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:15.923576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:15.928122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-15f12f81-4ca2-4f5c-bb16-c8bf373d9592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:15.932973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 887/1758] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:15 2022] DELETE /identity/v3/projects/50ae7202bee24f40b34f6c6b726df247 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:15.936043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0308-43c2-4028-a7a2-63cd69b19deb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.938220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0308-43c2-4028-a7a2-63cd69b19deb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.938726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0308-43c2-4028-a7a2-63cd69b19deb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:15.945391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 888/1759] 10.222.0.57 () {54 vars in 912 bytes} [Fri Jul 15 19:31:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:15.947137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.950862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.951283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.016051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:16.020049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.075893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:16.081328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.082528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.082954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] PATH_INFO: `/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6/users/353231a5b767413eb62e51bb12ff175e/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.152637 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd888614d8894c1ea2c1dfcc2f1d23b6, user_id=353231a5b767413eb62e51bb12ff175e, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:16.157544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65348-666d-45c1-86d4-b595d748df4e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:16.202983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:16.220250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 872/1760] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:15 2022] PUT /identity/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6/users/353231a5b767413eb62e51bb12ff175e/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:16.223803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.223803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.223803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.256462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 889/1761] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:16.257634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:16.265044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.283358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:16.285942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.463544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413164e0-1ace-45e5-b548-ce104b3200f8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:16.479016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 873/1762] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:31:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:16.480496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:16.485718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.591351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:16.633790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:16.634852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.635359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.637706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.644860 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.761068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:16.762722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc283eea-bb84-424c-89d2-276bdd17e26b service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:16.786746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 890/1763] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:16.789581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90ce0-bad3-484e-8adb-0eb158fd91da None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.790736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90ce0-bad3-484e-8adb-0eb158fd91da None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.792023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90ce0-bad3-484e-8adb-0eb158fd91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.840638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643d315-e748-434e-aae4-67f76d97b497 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:16.846589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-97e90ce0-bad3-484e-8adb-0eb158fd91da None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:16.851332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-97e90ce0-bad3-484e-8adb-0eb158fd91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.861648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:16.865374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.865672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.865961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.866755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:16.872522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 891/1764] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:16.874061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:16.875372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.875815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.876923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.926638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 874/1765] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:16.927671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:16.930074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:16.933997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.937925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:16.953113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 892/1766] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jul 15 19:31:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:16.954321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:16.972698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e969-0185-4663-ad9e-6a4d0dfe73d8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:16.977987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:16.979149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:16.979338 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:16.980132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:16.981044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:16.981462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:16.984172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:16.984883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d681-cd34-4078-a33b-e0ce9b09135c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.000579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.003952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 893/1767] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:17.004935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.005076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.005230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.005511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.023892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e09d-3f75-4096-be81-2dcfd849ea12 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.025521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.031059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.032152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.032579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.032956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] PATH_INFO: `/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6/users/353231a5b767413eb62e51bb12ff175e/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.036606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd888614d8894c1ea2c1dfcc2f1d23b6, user_id=353231a5b767413eb62e51bb12ff175e, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.040054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.047342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.052465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 875/1768] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:17.052856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.055868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:17.083545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923766f-c984-45d4-be0c-2f8e19eb8465 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.107217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 894/1769] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:17 2022] PUT /identity/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6/users/353231a5b767413eb62e51bb12ff175e/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:17.108321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.204173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:17.205973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.207095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.207251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.207603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.224871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.231510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0f75e-0dd3-4730-88a1-f71e99948eb7 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.259221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 876/1770] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:17.268452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.268899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.269341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.310450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7a03-abe8-467c-a2f3-ed00d7f302b4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.332494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.333184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.333462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.333776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.334486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.337350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.350494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] MFA Rules not processed for user `353231a5b767413eb62e51bb12ff175e`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:17.351817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:17.425282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 895/1771] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:17 2022] POST /identity/v3/projects => generated 365 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:17.427289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.603201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283339-ae2d-40d1-b97d-0fe04a5b29e2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.611880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.612917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.616932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.617340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.618176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.621382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.642147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 877/1772] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:17.659181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.680638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 896/1773] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:17 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:17.685006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.730994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1553dd-218a-4248-a5a3-18660ea87bf1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.772293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.781300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.789258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.789866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.791040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.804212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.809472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:17.838227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 897/1774] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:17.851316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.876703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6c4d-259e-48fe-8d4d-91996944d4c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.895202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.896237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.896785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be478bb4-59ee-4913-93ec-ab44358cbc83 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.897319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.898462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.899511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.901732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.940256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 898/1775] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:17.957234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.988250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55b24-d531-405f-9aeb-aa63e2ee9ac7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:18.001109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:18.002438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:18.002974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:18.004390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] PATH_INFO: `/v3/projects/128ca3248c58429284ff3251fd4fbb95/users/400763af11864659b341f1994c4d8e22/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:18.036856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] RBAC: Authorizing `identity:create_grant(project_id=128ca3248c58429284ff3251fd4fbb95, user_id=400763af11864659b341f1994c4d8e22, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:18.043835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:18.071874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 899/1776] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:17 2022] PUT /identity/v3/projects/128ca3248c58429284ff3251fd4fbb95/users/400763af11864659b341f1994c4d8e22/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:18.072830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:18.078915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:18.112128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:18.116962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:18.117284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:18.117784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:18.184848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409716-1c41-4b69-9659-da568ec7783f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:18.193423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:18.196815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:18.197728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:18.199729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:18.204589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:18.225772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:18.304428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:18.307384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3b50c-f7fd-4c56-91db-255f07ae1b22 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:18.341530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 878/1777] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:18.349646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:18.350137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:18.351347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:18.392586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:18.395622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:18.438143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 900/1778] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:18.453706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] MFA Rules not processed for user `400763af11864659b341f1994c4d8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:18.464430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:18.638832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 879/1779] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:18.644605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:18.849004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7633f-9056-4c9c-a23a-4352111a2167 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:18.867069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:18.867872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:18.868162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:18.878552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:18.880107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:18.882431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:19.050527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 901/1780] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:18 2022] POST /identity/v3/projects => generated 363 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:19.051421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:19.100236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58df7-6246-4fb0-b2fe-191e1072d4e7 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:19.226257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:19.405883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:19.406746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:19.408933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:19.409329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:19.410453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:19.418826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:19.517592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 880/1781] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:19 2022] POST /identity/v3/users => generated 288 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:19.519455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:19.547523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17804d9-c0b8-4bf0-b83c-b5a21f4da8f8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:19.564924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:19.566438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:19.567071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:19.568389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:19.569934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:19.573135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:19.621422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:19.627812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 902/1782] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:19.633141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedf67-0314-438c-a572-37e66d89bd56 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:19.656834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:19.657787 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:19.658096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:19.658398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] PATH_INFO: `/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a/users/4fc59d31d3864529bbfc72ba941db79c/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:19.739014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4573ca5a01a4258b5a59b2e4a88186a, user_id=4fc59d31d3864529bbfc72ba941db79c, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:19.742454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7a3f-9a3d-43f6-a047-066579f3f964 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:19.760587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:19.806087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 881/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:19 2022] PUT /identity/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a/users/4fc59d31d3864529bbfc72ba941db79c/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:19.808510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed58e-f08e-4a2f-8f34-9a8b5fc6904d None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:19.809315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed58e-f08e-4a2f-8f34-9a8b5fc6904d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:19.809777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed58e-f08e-4a2f-8f34-9a8b5fc6904d None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:19.811888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 882/1784] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:31:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:19.814004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ed58e-f08e-4a2f-8f34-9a8b5fc6904d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:20.106108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b01b4b-fa4d-4621-aebb-e5e21d2cdcdd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:20.123902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ed58e-f08e-4a2f-8f34-9a8b5fc6904d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:20.139375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:20.140231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.140523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.140799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.141697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:20.168722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c031d-b9ee-4e4b-a0c0-ed7044def869 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:20.219554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 883/1785] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:20.221092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef6b6-c15e-4004-ae94-463bc8aace8b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.221384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef6b6-c15e-4004-ae94-463bc8aace8b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.221667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef6b6-c15e-4004-ae94-463bc8aace8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.247575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:20.300267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f3cef6b6-c15e-4004-ae94-463bc8aace8b None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:20.301662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f3cef6b6-c15e-4004-ae94-463bc8aace8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:20.393169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '353231a5b767413eb62e51bb12ff175e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:20.394558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.396525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.397035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.399727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:20.402230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:20.406833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:20.438439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 903/1786] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 679 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:20.451818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:20.496404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756d3c-a7a0-4d71-82d3-6dfeaca7acb6 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:20.505931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435a84-9937-4958-b577-18138f335999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:20.507216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435a84-9937-4958-b577-18138f335999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.508923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435a84-9937-4958-b577-18138f335999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.508923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435a84-9937-4958-b577-18138f335999 admin admin] PATH_INFO: `/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a/users/4fc59d31d3864529bbfc72ba941db79c/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.522211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67435a84-9937-4958-b577-18138f335999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4573ca5a01a4258b5a59b2e4a88186a, user_id=4fc59d31d3864529bbfc72ba941db79c, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:20.530224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67435a84-9937-4958-b577-18138f335999 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:20.560361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 904/1787] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:20 2022] PUT /identity/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a/users/4fc59d31d3864529bbfc72ba941db79c/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:20.571268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435a84-9937-4958-b577-18138f335999 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:20.581910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 884/1788] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:31:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:20.585808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.587069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.587766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.695854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] MFA Rules not processed for user `4fc59d31d3864529bbfc72ba941db79c`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:20.697173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:20.722489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:20.850568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435a84-9937-4958-b577-18138f335999 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:20.888627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '353231a5b767413eb62e51bb12ff175e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:20.890504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.890840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.891143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.894181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:20.901757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:20.977953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 905/1789] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:20 2022] POST /identity/v3/projects => generated 354 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:20.981569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:21.057599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 885/1790] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:21.074084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:21.236541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaceda8-99fa-48ae-a594-104944ff79c1 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:21.252361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '353231a5b767413eb62e51bb12ff175e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:21.253242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:21.253444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:21.253755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:21.254580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:21.256474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:21.259693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:21.303189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 906/1791] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:21.470831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:21.495025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf954-912a-463b-b4b0-2efdea6860ba tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:21.499904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b2fcc-3da9-4bec-891e-47570c7e7026 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:21.531307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '353231a5b767413eb62e51bb12ff175e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:21.540224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:21.540543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:21.540829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] PATH_INFO: `/v3/projects/3f2534ea50b44b07a056af6004851531` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:21.548553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f2534ea50b44b07a056af6004851531)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:21.562649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:21.717236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:21.719866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:21.719989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:21.720196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:21.720636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:21.839804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2534ea50b44b07a056af6004851531', 'request_id': 'req-da8b3d15-4ecd-467d-a89b-727c5932ae81'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:21.875597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2534ea50b44b07a056af6004851531', 'request_id': 'req-da8b3d15-4ecd-467d-a89b-727c5932ae81'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:21.894736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2534ea50b44b07a056af6004851531', 'request_id': 'req-da8b3d15-4ecd-467d-a89b-727c5932ae81'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:21.920303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] The token cache is being invalidate because project 3f2534ea50b44b07a056af6004851531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:21.920831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:21.936568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-da8b3d15-4ecd-467d-a89b-727c5932ae81 tempest-VolumeQuotaClassesTest-1245992120 tempest-VolumeQuotaClassesTest-1245992120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:21.940551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 907/1792] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:21 2022] DELETE /identity/v3/projects/3f2534ea50b44b07a056af6004851531 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:21.943634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:21.943998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:21.944651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:21.948416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:21.957674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:21.975044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] MFA Rules not processed for user `59a76b6656854ed6a845a451dfcc0185`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:21.976986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:22.027429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 886/1793] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 954 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:22.031724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:22.035487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:22.107465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:22.230377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 908/1794] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:22.343309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5c3a-9ba7-41b9-ac56-dc86753529b6 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:22.505954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:22.508218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:22.509610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:22.509945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:22.515652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:22.552666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:22.567240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:22.603453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:22.605092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:22.632550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 887/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:22.823011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a46a-c451-4e80-a03a-0dcfd8c012cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:22.844093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:22.844093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:22.844093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:22.844093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:22.846100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.003596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:23.005827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.007858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:23.010060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0b95-85ff-4852-9a2a-e0bfe23a6d0c service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:23.027131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 909/1796] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:23.124563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f712c-8cba-4897-b600-752e897353aa service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:23.136960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:23.138864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:23.140116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:23.142677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] PATH_INFO: `/v3/users/a472bcce818c41e2ba8c9b641c4be3c5` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:23.145691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a472bcce818c41e2ba8c9b641c4be3c5)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:23.152472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:23.299196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:23.326213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a472bcce818c41e2ba8c9b641c4be3c5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:23.359478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a472bcce818c41e2ba8c9b641c4be3c5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:23.360433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a472bcce818c41e2ba8c9b641c4be3c5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:23.379875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a472bcce818c41e2ba8c9b641c4be3c5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:23.385543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a472bcce818c41e2ba8c9b641c4be3c5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:23.421729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 888/1797] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:23 2022] DELETE /identity/v3/users/a472bcce818c41e2ba8c9b641c4be3c5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:23.426821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:23.427096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:23.427377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:23.464095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:23.465410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.478090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:23.652487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 910/1798] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:23.659570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:23.663659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.870312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdb5a-38dc-4fc3-9237-5df78da1b26b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:23.876028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:23.876887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:23.877242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:23.877620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:23.908864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:23.911975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:23.941493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 889/1799] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:25.253555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:25.255876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:25.284346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a2b2-1d46-4534-a85c-1c0c9a9104ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:25.297915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:25.299908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.300250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.300790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] PATH_INFO: `/v3/projects/62bfa478ab954e63bc0914ca97b0fa46` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.305413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bfa478ab954e63bc0914ca97b0fa46)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:25.310169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:25.414848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bfa478ab954e63bc0914ca97b0fa46', 'request_id': 'req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.439262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bfa478ab954e63bc0914ca97b0fa46', 'request_id': 'req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.485436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bfa478ab954e63bc0914ca97b0fa46', 'request_id': 'req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.522702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] The token cache is being invalidate because project 62bfa478ab954e63bc0914ca97b0fa46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:25.523018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.523702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c6f1bf6c-23a1-467f-aeac-391fe35d0ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.528176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 911/1800] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:25 2022] DELETE /identity/v3/projects/62bfa478ab954e63bc0914ca97b0fa46 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:25.529421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:25.549452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643cf0a-7bf4-4d44-a9f7-c3ed5ac372de service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:25.664918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5aacb-d00a-4145-841b-c242f7ba660b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.667754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5aacb-d00a-4145-841b-c242f7ba660b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.668288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5aacb-d00a-4145-841b-c242f7ba660b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.670293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 912/1801] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:31:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:31:25.703673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.703964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.704208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.708754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:25.709928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.710651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.710977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] PATH_INFO: `/v3/users/353231a5b767413eb62e51bb12ff175e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.712953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=353231a5b767413eb62e51bb12ff175e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:25.718294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:25.772906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:25.781711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:25.899277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353231a5b767413eb62e51bb12ff175e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.920398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:25.933729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353231a5b767413eb62e51bb12ff175e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.934529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353231a5b767413eb62e51bb12ff175e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.950538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353231a5b767413eb62e51bb12ff175e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.955317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353231a5b767413eb62e51bb12ff175e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:25.985923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 890/1802] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:25 2022] DELETE /identity/v3/users/353231a5b767413eb62e51bb12ff175e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:26.064495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 913/1803] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:31:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:26.064695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:26.068954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.258247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd130d-0b2b-4235-98cc-1c13eddfdabc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:26.264965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:26.265966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:26.266244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:26.266516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] PATH_INFO: `/v3/users/639f6f674d324ec691b16fd62d81de3c` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:26.267877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639f6f674d324ec691b16fd62d81de3c)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:26.270093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:26.382262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:26.383854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.413681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639f6f674d324ec691b16fd62d81de3c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:26.417796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f8f0-594d-405f-b0d7-ca93ff410950 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:26.476530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639f6f674d324ec691b16fd62d81de3c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:26.479102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639f6f674d324ec691b16fd62d81de3c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:26.521252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:26.529150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639f6f674d324ec691b16fd62d81de3c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:26.538324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e03dd10a-a3c8-4cce-9b07-2c08b4516134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639f6f674d324ec691b16fd62d81de3c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:26.561128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 891/1804] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:26 2022] DELETE /identity/v3/users/639f6f674d324ec691b16fd62d81de3c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:26.567357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:26.567877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:26.568788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:26.600278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:26.601818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.695547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:26.696553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:26.697048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:26.698312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:26.703072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.730823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:26.732835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:26.739956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:26.770625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 914/1805] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:26.793812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 892/1806] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:26.917212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:26.919200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.087891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:27.089886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.093368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcd58-ef01-42bc-a318-222531eb43a6 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:27.137510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01e833-ec24-48d6-8c0c-f86275a959e7 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:27.157461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:27.158389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:27.158673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:27.158988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] PATH_INFO: `/v3/users/400763af11864659b341f1994c4d8e22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:27.162376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400763af11864659b341f1994c4d8e22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:27.164510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:27.297981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400763af11864659b341f1994c4d8e22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:27.354725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:27.357403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:27.357825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400763af11864659b341f1994c4d8e22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:27.359470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:27.359677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400763af11864659b341f1994c4d8e22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:27.360088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:27.409981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.426111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400763af11864659b341f1994c4d8e22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:27.427253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8f48c6b7-2f54-42ab-891a-565553b731d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400763af11864659b341f1994c4d8e22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:27.447450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:27.450397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:27.463516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 893/1807] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:27 2022] DELETE /identity/v3/users/400763af11864659b341f1994c4d8e22 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:27.469504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:27.470452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:27.470749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:27.485014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 915/1808] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:27.509422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:27.510899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.648633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 894/1809] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:27.703004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:27.704722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.722070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:27.723973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:27.740050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f51b-83ef-4929-a134-e18d8d2ee4ee service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:27.756187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144a440-cddd-4b7c-8430-3ac468fb25cd None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:27.789912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:27.794555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:27.795332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:27.796338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] PATH_INFO: `/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:27.803172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd888614d8894c1ea2c1dfcc2f1d23b6)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:27.812279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:27.939117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:27.940485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:27.940951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:27.941233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:27.960804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:27.963104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:27.978008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 916/1810] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:28.008245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'request_id': 'req-25c64c2b-9715-4d2c-8a60-11e0dd72558e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.024006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'request_id': 'req-25c64c2b-9715-4d2c-8a60-11e0dd72558e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.033802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd888614d8894c1ea2c1dfcc2f1d23b6', 'request_id': 'req-25c64c2b-9715-4d2c-8a60-11e0dd72558e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.038711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:28.078320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] The token cache is being invalidate because project cd888614d8894c1ea2c1dfcc2f1d23b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:28.078595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.079596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-25c64c2b-9715-4d2c-8a60-11e0dd72558e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.085346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 895/1811] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:27 2022] DELETE /identity/v3/projects/cd888614d8894c1ea2c1dfcc2f1d23b6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:28.087660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.088140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225265-67ed-4ab9-993c-91c09280bcc1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.088725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225265-67ed-4ab9-993c-91c09280bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.089003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225265-67ed-4ab9-993c-91c09280bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.089451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.127881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e9225265-67ed-4ab9-993c-91c09280bcc1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:28.128781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c96740-e8d3-44ec-9cc0-95501ffb1710 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.130483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e9225265-67ed-4ab9-993c-91c09280bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.156424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:28.272744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.273952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.274403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.274871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] PATH_INFO: `/v3/users/a938bdad8cb64343817b3c72e717075c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.276587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a938bdad8cb64343817b3c72e717075c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.278723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.332384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 896/1812] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:28.345588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.345895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.348170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.387543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:28.388825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.405317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 897/1813] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:28.409908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.427048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25e994-f2d8-463c-9e89-a371d2e70f2b None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.439486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.440278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.440654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.441038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.441883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:28.442281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.442813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a938bdad8cb64343817b3c72e717075c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.449925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.463037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a938bdad8cb64343817b3c72e717075c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.464435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a938bdad8cb64343817b3c72e717075c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.481398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 898/1814] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:31:28.482729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.484529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a938bdad8cb64343817b3c72e717075c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.486164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.487500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faaa5cb4-7db0-43b4-a669-23e3a85f1769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a938bdad8cb64343817b3c72e717075c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:28.510364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b585f-d267-41af-9aa1-da8b782f56e2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.521264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.521501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.521796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.521952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 917/1815] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:28 2022] DELETE /identity/v3/users/a938bdad8cb64343817b3c72e717075c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:28.522127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.523065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.524764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.525276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.525717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.526539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.567680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:28.571013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.588401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 899/1816] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:28 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:28.590396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.707336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 918/1817] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:28.754688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aead7-a4e4-4500-98df-cf775961638f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.768988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.769736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.770204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.770488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.771283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.778198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.816054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.817723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.822832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 900/1818] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:28 2022] POST /identity/v3/users => generated 305 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:28.828108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.854580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558b14-0181-45d8-b8e2-d9762111c9c2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.861259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.862707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.863455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.863782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.864824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.869413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.889750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 901/1819] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:28.891209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:28.893692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:28.897307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:28.926891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205bc0-92d7-4548-b36c-74587a7369d4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:28.940455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:28.941575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:28.941863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:28.942442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] PATH_INFO: `/v3/projects/867d0ef4c3634989875be8a3dc78607e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:28.944101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] RBAC: Authorizing `identity:delete_project(project_id=867d0ef4c3634989875be8a3dc78607e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:28.948478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:28.951826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759171-601a-44b4-9d81-61921545ba5b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.013726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:29.074183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.074906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.075192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.075473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.080582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867d0ef4c3634989875be8a3dc78607e', 'request_id': 'req-217f3ef8-2cbb-4f51-aa97-34973177803d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.090802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.091736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.095849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867d0ef4c3634989875be8a3dc78607e', 'request_id': 'req-217f3ef8-2cbb-4f51-aa97-34973177803d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.105875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 919/1820] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:29.106951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.110256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867d0ef4c3634989875be8a3dc78607e', 'request_id': 'req-217f3ef8-2cbb-4f51-aa97-34973177803d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.120535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa39e-2749-48b9-b5e3-8bf5f546cb72 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.132251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] The token cache is being invalidate because project 867d0ef4c3634989875be8a3dc78607e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:29.132611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.133578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.136870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 902/1821] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:28 2022] DELETE /identity/v3/projects/867d0ef4c3634989875be8a3dc78607e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:29.140664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.144599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.209661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.211487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.211813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.212131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.221943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.223721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.242079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 920/1822] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:29.243042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.245823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.248354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3ef8-2cbb-4f51-aa97-34973177803d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.254830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.256790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.257609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.258093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] PATH_INFO: `/v3/users/463c648521634a32bd5b32a87e384137` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.259835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] RBAC: Authorizing `identity:delete_user(user_id=463c648521634a32bd5b32a87e384137)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.260496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b454-424f-4e06-b5f1-87317180e3a2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.263324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.265994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.267427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.267718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.268000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] PATH_INFO: `/v3/projects/740cd07c5fd34c749334d206ad01700a/users/2d362e4278ef459d847add0e578c5e00/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.293916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740cd07c5fd34c749334d206ad01700a, user_id=2d362e4278ef459d847add0e578c5e00, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.301962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dd6ab-1a33-4432-a260-f34625d86857 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.336335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 921/1823] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:29 2022] PUT /identity/v3/projects/740cd07c5fd34c749334d206ad01700a/users/2d362e4278ef459d847add0e578c5e00/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:29.347561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.347868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.348241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.363725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463c648521634a32bd5b32a87e384137'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.390712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] MFA Rules not processed for user `2d362e4278ef459d847add0e578c5e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:29.393439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.396132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463c648521634a32bd5b32a87e384137'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.397738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463c648521634a32bd5b32a87e384137'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.413343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463c648521634a32bd5b32a87e384137'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.414664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463c648521634a32bd5b32a87e384137'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.453017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 903/1824] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:29 2022] DELETE /identity/v3/users/463c648521634a32bd5b32a87e384137 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:29.454927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.456827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.465171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:29.496191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 922/1825] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:29.497042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.502436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.530154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:29.596962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b25-3d04-4cd6-b526-28e21ce2480b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.605891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.607863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.608704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.610359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] PATH_INFO: `/v3/projects/128ca3248c58429284ff3251fd4fbb95` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.637044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240455c7-a38b-477a-b08d-fdd039c49337 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.646841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.647976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.648460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.648882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.649774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.652226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.653470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=128ca3248c58429284ff3251fd4fbb95)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.674425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.723024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 923/1826] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:29 2022] POST /identity/v3/projects => generated 407 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:29.728107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.821521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50e36-211d-4171-b267-6bf1152c3342 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.857455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128ca3248c58429284ff3251fd4fbb95', 'request_id': 'req-43e716d7-ac6d-457a-ad5b-502b534a1e2d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.882040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128ca3248c58429284ff3251fd4fbb95', 'request_id': 'req-43e716d7-ac6d-457a-ad5b-502b534a1e2d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.895018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128ca3248c58429284ff3251fd4fbb95', 'request_id': 'req-43e716d7-ac6d-457a-ad5b-502b534a1e2d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.910459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.911254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.911546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.911822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.912541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.914955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.920609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] The token cache is being invalidate because project 128ca3248c58429284ff3251fd4fbb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:29.921100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.922065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:29.927403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 904/1827] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:29 2022] DELETE /identity/v3/projects/128ca3248c58429284ff3251fd4fbb95 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:29.931492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.943373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.964149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 924/1828] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:29 2022] POST /identity/v3/users => generated 310 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:29.966955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:29.970690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e716d7-ac6d-457a-ad5b-502b534a1e2d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.970939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:29.984538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.985675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.985958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.986233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] PATH_INFO: `/v3/users/4fc59d31d3864529bbfc72ba941db79c` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.987786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda243-ac94-4d78-bb59-3b6015c3454a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:29.991580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc59d31d3864529bbfc72ba941db79c)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.993234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:29.993544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:29.993933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:29.994216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:29.994523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:29.995352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:29.997004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.010836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 925/1829] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:30.022544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.034082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:30.047899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73b90-412f-40bb-9fd8-289542a9a7ea admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.065655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.066898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.067381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.067805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] PATH_INFO: `/v3/projects/17161e4ad56848158ca50ed39071fab2/users/9feab07aaec9423da86c58a0017db4c6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.085155 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc59d31d3864529bbfc72ba941db79c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.096304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=17161e4ad56848158ca50ed39071fab2, user_id=9feab07aaec9423da86c58a0017db4c6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.101190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.101563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc59d31d3864529bbfc72ba941db79c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.102297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc59d31d3864529bbfc72ba941db79c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.112447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc59d31d3864529bbfc72ba941db79c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.115677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc59d31d3864529bbfc72ba941db79c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.144367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 905/1830] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:29 2022] DELETE /identity/v3/users/4fc59d31d3864529bbfc72ba941db79c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.146065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 926/1831] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:30 2022] PUT /identity/v3/projects/17161e4ad56848158ca50ed39071fab2/users/9feab07aaec9423da86c58a0017db4c6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.150195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.152519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.185689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.193404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:30.197225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.235138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb4728-1018-45dc-a156-55d2e4891354 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.242580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.243822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.244416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.244863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.246557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.248819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.267716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 906/1832] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:30.268856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.271097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.301031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778e82-39fe-4329-b912-e875dfbd0160 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.309802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.311409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.311861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.312765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] PATH_INFO: `/v3/projects/025b63313d994c7db69a28d6d6afb960` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.314735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] RBAC: Authorizing `identity:delete_project(project_id=025b63313d994c7db69a28d6d6afb960)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.316760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.327523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423836-de91-491c-b9f3-a385a2117cbc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.334888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.335800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.336280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.336618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] PATH_INFO: `/v3/projects/45a45c6af12c463a9b04b06f422fc05a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.338074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a45c6af12c463a9b04b06f422fc05a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.340682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.395757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025b63313d994c7db69a28d6d6afb960', 'request_id': 'req-cffa31fb-56a8-4bcd-a916-883eb58a072c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.418568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025b63313d994c7db69a28d6d6afb960', 'request_id': 'req-cffa31fb-56a8-4bcd-a916-883eb58a072c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.421684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a45c6af12c463a9b04b06f422fc05a', 'request_id': 'req-06786f0c-3559-42e9-8ecd-381dd86ea232'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.430737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025b63313d994c7db69a28d6d6afb960', 'request_id': 'req-cffa31fb-56a8-4bcd-a916-883eb58a072c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.435043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a45c6af12c463a9b04b06f422fc05a', 'request_id': 'req-06786f0c-3559-42e9-8ecd-381dd86ea232'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.441948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a45c6af12c463a9b04b06f422fc05a', 'request_id': 'req-06786f0c-3559-42e9-8ecd-381dd86ea232'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.450177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] The token cache is being invalidate because project 025b63313d994c7db69a28d6d6afb960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:30.451764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.452488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.459121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 907/1833] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:30 2022] DELETE /identity/v3/projects/025b63313d994c7db69a28d6d6afb960 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.459121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.459532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.462121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] The token cache is being invalidate because project 45a45c6af12c463a9b04b06f422fc05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:30.462612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.463705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06786f0c-3559-42e9-8ecd-381dd86ea232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.468951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 927/1834] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:30 2022] DELETE /identity/v3/projects/45a45c6af12c463a9b04b06f422fc05a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.469742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.469742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.471039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.495868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:30.497350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.565549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa31fb-56a8-4bcd-a916-883eb58a072c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.626350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 928/1835] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:30.627443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.628885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.644452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af28e4-45a8-4e22-8c10-e5fa02b8e4cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.652179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.653417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.653772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.654981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] PATH_INFO: `/v3/users/d5ff757b16974f0db4525f13cf8f8efe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.656488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ff757b16974f0db4525f13cf8f8efe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.658651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.670268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:30.692476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.693436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.693718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.693980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] PATH_INFO: `/v3/projects/17161e4ad56848158ca50ed39071fab2/users/9feab07aaec9423da86c58a0017db4c6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.696859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17161e4ad56848158ca50ed39071fab2, user_id=9feab07aaec9423da86c58a0017db4c6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.700144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.703730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:30.726936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 908/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:30 2022] PUT /identity/v3/projects/17161e4ad56848158ca50ed39071fab2/users/9feab07aaec9423da86c58a0017db4c6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.728043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:30.730135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.771374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ff757b16974f0db4525f13cf8f8efe'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.808561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ff757b16974f0db4525f13cf8f8efe'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.811032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ff757b16974f0db4525f13cf8f8efe'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.825082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ff757b16974f0db4525f13cf8f8efe'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.827153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a2d7855-23eb-49a5-bfa7-5fb0c65effb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ff757b16974f0db4525f13cf8f8efe'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:30.845077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b760d2-ae8b-453b-9918-f3248f3a1c3f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:30.850382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 929/1837] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:30 2022] DELETE /identity/v3/users/d5ff757b16974f0db4525f13cf8f8efe => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:30.850382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f521-1496-461d-a7f7-630b7d850ea3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.850382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f521-1496-461d-a7f7-630b7d850ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.850382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f521-1496-461d-a7f7-630b7d850ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.873843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5585f521-1496-461d-a7f7-630b7d850ea3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:30.875161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5585f521-1496-461d-a7f7-630b7d850ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:30.916638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:30.917762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.918614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.918614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] PATH_INFO: `/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:30.919817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4573ca5a01a4258b5a59b2e4a88186a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:30.922301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:30.989772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 930/1838] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:30.991416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814dc3a-f19f-4512-a48f-a17978889b94 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:30.991719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814dc3a-f19f-4512-a48f-a17978889b94 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:30.992065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814dc3a-f19f-4512-a48f-a17978889b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.046997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4573ca5a01a4258b5a59b2e4a88186a', 'request_id': 'req-c0d0f700-5fc8-45b7-9e84-1472a379b797'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:31.058677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4573ca5a01a4258b5a59b2e4a88186a', 'request_id': 'req-c0d0f700-5fc8-45b7-9e84-1472a379b797'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:31.059438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7814dc3a-f19f-4512-a48f-a17978889b94 None None] MFA Rules not processed for user `9feab07aaec9423da86c58a0017db4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:31.064323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7814dc3a-f19f-4512-a48f-a17978889b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:31.069125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4573ca5a01a4258b5a59b2e4a88186a', 'request_id': 'req-c0d0f700-5fc8-45b7-9e84-1472a379b797'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:31.084517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] The token cache is being invalidate because project f4573ca5a01a4258b5a59b2e4a88186a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:31.085390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:31.086421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:31.089207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 909/1839] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:30 2022] DELETE /identity/v3/projects/f4573ca5a01a4258b5a59b2e4a88186a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:31.090037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.091424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:31.129623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:31.181494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 931/1840] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:31.185666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.185666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.185666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.189066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f700-5fc8-45b7-9e84-1472a379b797 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.199915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.200618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.200900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.201176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.206055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:31.206055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.207652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.211504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:31.223138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:31.224378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:31.231644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 910/1841] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:31.233115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.235662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:31.243744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 932/1842] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:31.244959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.259224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973012d9-c70d-4df9-989b-21ec20d82785 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.266415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.267705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.268145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.268556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.269479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.272064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2462f5c-a782-4534-915a-0217a9409483 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.311412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 933/1843] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:31.313519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.313962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.314383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.323629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6d71-3e5e-418a-ab9b-f0f7f43a3b60 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.356567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:31.358004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:31.431262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 934/1844] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:31.431931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.444959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924aaf8-e28b-4ba7-90d1-929ac0528d8e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.451761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.452466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.452597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.453163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.453440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.453712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.454476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.454584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.454741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.458467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.491031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 935/1845] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:31.493021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.514916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e831-3426-4020-a8a1-b12e0ffbb9ac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.520625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.521428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.521811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.522185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.523082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:31.523494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.525211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.539210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 936/1846] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:31.543712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.561683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683b888-3bd2-46ac-8e24-9390e638896d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.565812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.568433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.568977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.569969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.570342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.570670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.571637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.574016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.586734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 911/1847] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:31.587892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 937/1848] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:31.589201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.592433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.604466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818825-f78e-442c-afe2-9429e5ff02b1 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.605132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69568db9-7398-45f0-90f5-e395ac475d7e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.610346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.611054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.611317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.611450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.611590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.612286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.612444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.612823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.613412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.614244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.614403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.617935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.649211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 938/1849] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:31.651971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.657738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 912/1850] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:31.659570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.677436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7a36d-c1bc-47bf-aae1-ce9d96a6bf83 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.679109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:31.746072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fedd8-d183-43c4-8390-73b3a3367548 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.752769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.752995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.753113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.753345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.753580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.753681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] PATH_INFO: `/v3/projects/4a85c11c9d6f482f99a79a2d7e12e46e/users/26727fa2ea1e4a49a8403a37cec29aab/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.754028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.754702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.756074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.758095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.773456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a85c11c9d6f482f99a79a2d7e12e46e, user_id=26727fa2ea1e4a49a8403a37cec29aab, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.776552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f5d8d-3caa-4a94-b6e9-ae4a14f3b171 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.804907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 913/1851] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:31.806334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.820348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 939/1852] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:31 2022] PUT /identity/v3/projects/4a85c11c9d6f482f99a79a2d7e12e46e/users/26727fa2ea1e4a49a8403a37cec29aab/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:31.833259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c155-89f9-46e0-8968-e1f2f835b1b3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:31.834537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.835050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.835988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.910640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:31.912520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:31.914382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:31.914382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:31.914382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:31.915190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:31.917262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:31.934514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] MFA Rules not processed for user `26727fa2ea1e4a49a8403a37cec29aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:31.941793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 914/1853] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:31.942978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:31.943106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:32.061504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 940/1854] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:32.062941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.070657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0129e69-a489-4bc6-a820-577dfde2108a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.079908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.080839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.081392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.082579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.085884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:32.086008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3d439-4a26-497d-ba1e-0b0aeb8021c1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.099850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.100767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.101151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.101526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.102538 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.104869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.120883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 941/1855] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:32.121967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.138951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe1fdf-7a86-4bfa-939e-6bb2cd4bd2ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.144802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.145747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.146128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.146546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.147724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.150223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.192443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 942/1856] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:32 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:32.194478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.204906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:32.228202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.230225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.244285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 915/1857] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:32.245843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.287955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b7c0-4187-4dce-bec9-4042363f6c95 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.346131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee7fc-85c0-4f95-a772-1d9362ca1840 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.359045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.363770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.364100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.365171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] PATH_INFO: `/v3/projects/950576fb9c9e4e1382707524660a2a1c/users/d58daac63bd24d09a6cb7fd118e66755/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.420110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950576fb9c9e4e1382707524660a2a1c, user_id=d58daac63bd24d09a6cb7fd118e66755, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.425233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.465954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.467058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.467190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.467463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.468282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.470465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc74078-558e-433c-80c7-b4cba1498c55 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.482329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 943/1858] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:32 2022] PUT /identity/v3/projects/950576fb9c9e4e1382707524660a2a1c/users/d58daac63bd24d09a6cb7fd118e66755/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:32.484777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.494836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:32.510988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 916/1859] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:32 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:32.513866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.514367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.514890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.548605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] MFA Rules not processed for user `d58daac63bd24d09a6cb7fd118e66755`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:32.553713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:32.591535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:32.609886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab44b-3b87-4ace-ba76-5c6de8624727 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.616431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.619218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.619801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.620146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] PATH_INFO: `/v3/projects/8089dacfd7ed49228c30502074d855d8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.622184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8089dacfd7ed49228c30502074d855d8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.624685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.722459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 917/1860] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:32.724356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.745462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8089dacfd7ed49228c30502074d855d8', 'request_id': 'req-00256220-5ce9-4ab6-a293-8ca79ed161f4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:32.749395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e003ff3-5244-4d80-aeab-c67d121dc9a0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.764183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8089dacfd7ed49228c30502074d855d8', 'request_id': 'req-00256220-5ce9-4ab6-a293-8ca79ed161f4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:32.775608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8089dacfd7ed49228c30502074d855d8', 'request_id': 'req-00256220-5ce9-4ab6-a293-8ca79ed161f4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:32.803876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] The token cache is being invalidate because project 8089dacfd7ed49228c30502074d855d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:32.803876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:32.806629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:32.810494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 944/1861] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:32 2022] DELETE /identity/v3/projects/8089dacfd7ed49228c30502074d855d8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:32.817453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:32.819598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:32.904302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.905644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.906241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.907404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.912784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.915228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573556b8-be95-48e1-9919-af138bf16111 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:32.957964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 918/1862] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:32.959278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.959901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.960348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.973153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256220-5ce9-4ab6-a293-8ca79ed161f4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:32.979153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:32.980030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:32.980543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:32.980891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:32.981773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:32.983934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.005376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:33.018576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 945/1863] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:32 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:33.019842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.021940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:33.057043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:33.060242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:33.175118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599abd5d-6d86-4733-9c9e-dd94afe3c47c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.187170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.188149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.188618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.189739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 919/1864] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:33.190697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.192645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.193588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.198208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645c8bb-44f3-4380-ad56-7f42ef7fb0a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.214455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:33.219987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a327-4579-4c4b-8cd3-bf0084b465f9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.230725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 946/1865] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.234068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.236922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.237340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.237589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.238478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.239044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.239518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.248180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.255606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.286638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:33.288117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:33.292740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 920/1866] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:33.294723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.309164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 947/1867] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:33.309285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b4ba-3037-412e-8c73-2f3aa5ab435b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.311304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.317909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.319089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.319257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.319535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] PATH_INFO: `/v3/projects/c558b0b85358497d838f03f00b3c818a/users/64026411c855409d97697a2b3ceb843f/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.337543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c558b0b85358497d838f03f00b3c818a, user_id=64026411c855409d97697a2b3ceb843f, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.339489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d3c1-d30c-40b5-b0ad-6fa2d399ecf8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.340740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.344575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.345382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.345729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.346063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.347079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.349063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dc516-2d23-4d10-9365-fc6099fa8244 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.362874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 921/1868] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:33 2022] PUT /identity/v3/projects/c558b0b85358497d838f03f00b3c818a/users/64026411c855409d97697a2b3ceb843f/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:33.363887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.386582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 948/1869] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.386582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.386582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.386582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.435101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] MFA Rules not processed for user `64026411c855409d97697a2b3ceb843f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:33.436645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:33.469887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c89d84-f889-4fb7-ad07-d8c0a6dcc37c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.476687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.477512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.477747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.478089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.479054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:33.479370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.481579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.499270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 922/1870] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:33.499270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.510348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c56f0-d6f1-4c21-b87c-a49eebd4fb63 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.515570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.516626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.516904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.517178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] PATH_INFO: `/v3/projects/cada152558414c2495207736bd994147/users/918a9607e295413cbbdc87e7c4a3ffe6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.533235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cada152558414c2495207736bd994147, user_id=918a9607e295413cbbdc87e7c4a3ffe6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.535955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.549160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 949/1871] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:33.549999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.551285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 923/1872] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:33 2022] PUT /identity/v3/projects/cada152558414c2495207736bd994147/users/918a9607e295413cbbdc87e7c4a3ffe6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:33.553543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.563636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc40eb-418d-4504-b4dd-05ed8d9df5c9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.588452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:33.618307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb01e-8c65-4e0e-ad8a-6e39f1829647 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.621456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.622141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.622422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.622695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.623593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.624656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.624946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.625048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.625230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.625924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.627037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.627879 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.655630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 950/1873] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:33.656494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.657400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 924/1874] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:33.659516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.728267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:33.733901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0992d1-b519-4e37-92a4-29cc93558d1e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.735553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2d27-f383-44ff-b923-ec35d530f77f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.740011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.741002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.741261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.741601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.742386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.746207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.750025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.753404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.754310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.754703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.755742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.757604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.768492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 925/1875] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/users => generated 279 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:33.769389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.784832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 951/1876] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.788260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3505b-780d-4549-8404-02fdd8d6a996 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.789895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.796882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.797767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.798060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.798335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.799078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.801143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b124b-68dc-4fd2-8ec0-705b26305a3d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.801271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.806747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.807674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.808005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.808641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.809250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.811140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.822296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 952/1877] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.823220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.831502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 926/1878] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:33.832446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.833453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b0ec-f3ea-4cb1-9bea-7325b5ec3fd3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.838061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.839021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.839309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.839582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] PATH_INFO: `/v3/projects/cada152558414c2495207736bd994147/users/918a9607e295413cbbdc87e7c4a3ffe6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.841552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cada152558414c2495207736bd994147, user_id=918a9607e295413cbbdc87e7c4a3ffe6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.842664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2477-8ebb-42fd-bb3b-2ba6bb03aadb admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.844241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.847198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.847855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.848138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.848420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.849148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.850775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a50f1-2129-43d6-a0a0-897b62fa15c8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.856108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 953/1879] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:33 2022] PUT /identity/v3/projects/cada152558414c2495207736bd994147/users/918a9607e295413cbbdc87e7c4a3ffe6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:33.857065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.870564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 927/1880] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.871929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.872221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.872496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.900376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] MFA Rules not processed for user `918a9607e295413cbbdc87e7c4a3ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:33.902174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:33.925682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb0ef-5695-4c1f-af06-7657092bc767 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.930766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.931483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.932191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.932640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.933415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.935693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:33.948873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 954/1881] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:33.949529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.960646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dd9bd-340e-44e4-b20e-8d2154e35455 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:33.966015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:33.967049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:33.967437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:33.967824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] PATH_INFO: `/v3/projects/57903da0d2dd43a29308e277ca9a0928/users/55d5704e54bf4e3ebaf8b75767b9cd7e/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:33.982658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 928/1882] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:33.983704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:33.990986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:33.991221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57903da0d2dd43a29308e277ca9a0928, user_id=55d5704e54bf4e3ebaf8b75767b9cd7e, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:33.995515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.000569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbc72-12bd-47c1-810f-4cd54eabf751 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.005687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.006645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.006961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.007237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] PATH_INFO: `/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5/users/1ad9f23054fd4189838432c84879c1a6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.013752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 955/1883] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:33 2022] PUT /identity/v3/projects/57903da0d2dd43a29308e277ca9a0928/users/55d5704e54bf4e3ebaf8b75767b9cd7e/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:34.014580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.016173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.024636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dc78b796514ecc9e0e0d054824e9c5, user_id=1ad9f23054fd4189838432c84879c1a6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.027473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebb49-1dc1-4276-a7b8-2929b6893953 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.051715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 929/1884] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:33 2022] PUT /identity/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5/users/1ad9f23054fd4189838432c84879c1a6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:34.053841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.054376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.054492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.088067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68de6-0a56-46e1-9639-0fcea27005eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.095375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] MFA Rules not processed for user `55d5704e54bf4e3ebaf8b75767b9cd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:34.096630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.154636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.155591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.156036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.156321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.166933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:34.185812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 930/1885] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:34.186759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.231843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.233432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.247975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 956/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:34.250579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.285739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff730-e6f8-457f-ab85-12bd7fa7fa3a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.291696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.292667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.293052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.293480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.294234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.296325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.312840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 931/1887] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:34.314645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.330071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd997-47e5-4c6b-840f-2a7209288bec admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.337868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.339182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.339472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.339901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] PATH_INFO: `/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5/users/1ad9f23054fd4189838432c84879c1a6/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.342278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dc78b796514ecc9e0e0d054824e9c5, user_id=1ad9f23054fd4189838432c84879c1a6, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.345017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a313884-9027-442d-a80d-87031773b563 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.352401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0121bd-2715-4a0a-a3f2-93a2cdbda143 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.358080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 932/1888] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:34 2022] PUT /identity/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5/users/1ad9f23054fd4189838432c84879c1a6/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:34.369011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.369304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.369629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.403231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] MFA Rules not processed for user `1ad9f23054fd4189838432c84879c1a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:34.404564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.423080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.423849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.424162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.424444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.425150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.427191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.446987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:34.454965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 957/1889] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:34 2022] POST /identity/v3/projects => generated 355 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:34.455880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.475605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 933/1890] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:34.476476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.486440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8ea8-087b-4302-b2d6-7bea32778a05 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.505521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:34.531114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c539e-5ae7-4b02-826b-ddabc8bd6c3d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.535924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.538367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.538367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.538367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] PATH_INFO: `/v3/users/d58daac63bd24d09a6cb7fd118e66755` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.539296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58daac63bd24d09a6cb7fd118e66755)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.541428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.558162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.558913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.559204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.559732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.560486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.562471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.591644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 934/1891] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:34 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:34.592616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.594494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.613508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58daac63bd24d09a6cb7fd118e66755'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:34.626816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58daac63bd24d09a6cb7fd118e66755'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:34.627708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58daac63bd24d09a6cb7fd118e66755'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:34.636149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58daac63bd24d09a6cb7fd118e66755'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:34.636756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58daac63bd24d09a6cb7fd118e66755'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:34.655413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 958/1892] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:34 2022] DELETE /identity/v3/users/d58daac63bd24d09a6cb7fd118e66755 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:34.656694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.659414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.659854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea0e2a-50a6-4828-9ea6-e6b9229ede25 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.723812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.724949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.725668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.725970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.728573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61a17-cee5-44bf-823e-215608d2cd8e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.729473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.733499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.734142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.734494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.734751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.735524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.737116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad488-2f47-4615-981b-a7807a17f997 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.751625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 959/1893] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:34.753390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.753792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.754171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.774101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:34.775497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.783626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 960/1894] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:34.784561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.791861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:34.794758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c645bc-545a-40fc-9bdb-20e57b02b136 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.800625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.802384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.802671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.803077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] PATH_INFO: `/v3/projects/58e3626fd7a140108ba99255dc521844/users/f0ecf05022a4406ca86636e12b5a8048/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.815026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.816623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.819543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e3626fd7a140108ba99255dc521844, user_id=f0ecf05022a4406ca86636e12b5a8048, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.822326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.825834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 935/1895] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:34.827420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.828910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:34.845773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 961/1896] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:34 2022] PUT /identity/v3/projects/58e3626fd7a140108ba99255dc521844/users/f0ecf05022a4406ca86636e12b5a8048/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:34.850031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.887683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:34.918177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02dfa-8826-4778-bceb-e40cbfb13b4a service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.940227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c2171-7fe7-4dac-9094-a65ac88ad9f1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.946160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.946883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.947172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.947518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.948273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.950293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:34.965437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 962/1897] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:34.969766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:34.982322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7667-5459-43b6-97c0-e55995e86597 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:34.987455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.988218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:34.988344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.988497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.988919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.989642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:34.990004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:34.990350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] PATH_INFO: `/v3/projects/58e3626fd7a140108ba99255dc521844/users/f0ecf05022a4406ca86636e12b5a8048/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:34.993546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e3626fd7a140108ba99255dc521844, user_id=f0ecf05022a4406ca86636e12b5a8048, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:34.996559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc7d82-bdd0-471b-9df6-8457fafa2852 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.000325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:35.002878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.016473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 963/1898] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:34 2022] PUT /identity/v3/projects/58e3626fd7a140108ba99255dc521844/users/f0ecf05022a4406ca86636e12b5a8048/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:35.019083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 936/1899] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:35.026923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:35.027218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:35.027543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:35.057956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] MFA Rules not processed for user `f0ecf05022a4406ca86636e12b5a8048`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:35.059885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:35.151542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 964/1900] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:35.168331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:35.170913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:35.312579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c7b8-6756-4c61-ad77-a9401e284ca4 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:35.359463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:35.361082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:35.405861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:35.406725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:35.407128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:35.407647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:35.415853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:35.418660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:35.420259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.433869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 937/1901] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:35 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:35.454639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febec168-8bf5-42ac-b017-c9a0c0f80cf0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:35.461507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:35.462417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:35.462714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:35.463036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] PATH_INFO: `/v3/projects/950576fb9c9e4e1382707524660a2a1c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:35.464466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=950576fb9c9e4e1382707524660a2a1c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:35.466946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.519095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:35.536176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7be4e4-a309-4b18-bd27-2476fb0df5a8 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:35.539263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:35.544333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950576fb9c9e4e1382707524660a2a1c', 'request_id': 'req-4903f5b1-a22d-4f49-b806-b9d5f89813eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.553985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950576fb9c9e4e1382707524660a2a1c', 'request_id': 'req-4903f5b1-a22d-4f49-b806-b9d5f89813eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.562544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950576fb9c9e4e1382707524660a2a1c', 'request_id': 'req-4903f5b1-a22d-4f49-b806-b9d5f89813eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.578682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] The token cache is being invalidate because project 950576fb9c9e4e1382707524660a2a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:35.579110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.579848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.582311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 965/1902] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:35 2022] DELETE /identity/v3/projects/950576fb9c9e4e1382707524660a2a1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:35.587104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:35.588795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:35.649372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:35.651999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:35.653042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:35.654920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:35.657471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:35.682759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f5b1-a22d-4f49-b806-b9d5f89813eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:35.689486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:35.690555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:35.690867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:35.691227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] PATH_INFO: `/v3/users/918a9607e295413cbbdc87e7c4a3ffe6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:35.692400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918a9607e295413cbbdc87e7c4a3ffe6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:35.694554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.737736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:35.737736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:35.746501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 938/1903] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:35.759949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918a9607e295413cbbdc87e7c4a3ffe6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.780694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918a9607e295413cbbdc87e7c4a3ffe6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.781604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918a9607e295413cbbdc87e7c4a3ffe6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.793294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918a9607e295413cbbdc87e7c4a3ffe6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.799501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f3d7bcb-34d9-42dd-94ae-c917be1f1896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918a9607e295413cbbdc87e7c4a3ffe6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:35.824442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 966/1904] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:35 2022] DELETE /identity/v3/users/918a9607e295413cbbdc87e7c4a3ffe6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:36.149158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:36.166955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7bdc-2d79-4c15-b0ee-9b117e8d897d service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:36.270838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:36.270838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.270838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.270838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] PATH_INFO: `/v3/projects/cada152558414c2495207736bd994147` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.271253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cada152558414c2495207736bd994147)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:36.271359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:36.347939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cada152558414c2495207736bd994147', 'request_id': 'req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:36.352753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:36.362040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cada152558414c2495207736bd994147', 'request_id': 'req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:36.374672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cada152558414c2495207736bd994147', 'request_id': 'req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:36.402907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] The token cache is being invalidate because project cada152558414c2495207736bd994147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:36.403328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:36.404066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:36.406039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 939/1905] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:36 2022] DELETE /identity/v3/projects/cada152558414c2495207736bd994147 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:36.411271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e9a3-5bb7-4b8a-85c5-e362e22d66e9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.411569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e9a3-5bb7-4b8a-85c5-e362e22d66e9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.412555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e9a3-5bb7-4b8a-85c5-e362e22d66e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.450969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-98f7e9a3-5bb7-4b8a-85c5-e362e22d66e9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:36.453296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-98f7e9a3-5bb7-4b8a-85c5-e362e22d66e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:36.508597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:36.510876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:36.528866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:36.561365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 967/1906] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:36.572001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.572739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.573217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.604388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:36.606433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:36.618309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 968/1907] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:36.622871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:36.625269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c59d-6204-4fa9-9cd5-c8abd47b1778 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:36.633561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:36.636375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e04e1c-7261-4056-bc79-38131462c399 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:36.637665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.638588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.638588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.642392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:36.645929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:36.646897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.647380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.647852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.649265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:36.649775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:36.653404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:36.691128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 969/1908] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:36.698038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:36.721982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7581-a4ae-4dab-9f6c-30b80f1e3b4b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:36.732897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:36.734262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.734558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.734868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.736703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:36.738869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:36.758238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:36.760076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:36.774504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 970/1909] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:36 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:36.779056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:36.781812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 940/1910] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:36.919796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2944b-af08-4f3d-89ef-feeab6574250 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:36.932230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:36.933047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:36.934848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:36.935162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:36.936939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:36.941655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:36.993054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 971/1911] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:36 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:36.996638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:37.014871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb39e0-9fa8-4e86-bd8d-f55ce1600658 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:37.023631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:37.025065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.029351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.029351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.029351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:37.031386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:37.056619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 941/1912] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:37.057364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:37.072477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e82be2-4785-46eb-a829-81f23e900dc7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:37.079994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:37.080696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.081214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.081507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.082264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:37.084861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086fa4c-9549-458f-8ae0-f4619e8cf9ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:37.103288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 972/1913] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:37.104547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:37.133075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed510e-9ab7-4801-9937-a6a66c19725b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:37.139509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:37.142007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.142534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.142873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] PATH_INFO: `/v3/projects/05dfe93925d7420690fdc60c744b8f68/users/01802fca5f4e41679389d00514ae6243/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.169391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dfe93925d7420690fdc60c744b8f68, user_id=01802fca5f4e41679389d00514ae6243, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:37.174987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:37.206082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 942/1914] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:37 2022] PUT /identity/v3/projects/05dfe93925d7420690fdc60c744b8f68/users/01802fca5f4e41679389d00514ae6243/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:37.218147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.218441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.218727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.254574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] MFA Rules not processed for user `01802fca5f4e41679389d00514ae6243`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:37.255989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:37.354635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:37.361477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 973/1915] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:37.558384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8beff-a928-4e63-8332-79cde7efe32d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:37.580466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:37.585876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.586187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.588004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.590257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:37.600948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:37.609033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:37.674536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 943/1916] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:37 2022] POST /identity/v3/projects => generated 379 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:37.680522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:37.700275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c7c92-6f4a-4875-bc17-734b1f8d96a1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:37.726828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:37.933447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:37.934158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:37.935659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:37.935659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:37.935659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:37.942854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:37.983833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.004280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 974/1917] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:37 2022] POST /identity/v3/users => generated 296 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:38.007011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.008805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.030237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ce62c-5d6a-4b95-bec7-b52b629fcfac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.036285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.037701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.038003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.038334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] PATH_INFO: `/v3/users/2d362e4278ef459d847add0e578c5e00` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.039649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d362e4278ef459d847add0e578c5e00)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.042486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.081200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649378f-137c-4a50-9481-89e71002a60b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.092036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.099595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.100077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.100458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.102881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.167467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d362e4278ef459d847add0e578c5e00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:38.190333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d362e4278ef459d847add0e578c5e00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:38.191566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d362e4278ef459d847add0e578c5e00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:38.202130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d362e4278ef459d847add0e578c5e00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:38.203155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d362e4278ef459d847add0e578c5e00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:38.235953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 975/1918] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:38 2022] DELETE /identity/v3/users/2d362e4278ef459d847add0e578c5e00 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:38.237126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.239657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.276350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.278403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396351-fbb0-4645-acec-7cf1c8e3207b service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.295848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 944/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:38.297925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.298212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.298506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.317738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:38.319011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.365555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d14d-6277-49b5-8bee-8369604f9e65 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.372679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.373789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.374254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.374717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.375705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.377526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.395831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 976/1920] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:38.400081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.416264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ab018-8e8f-4905-98dd-e9f678b87b4a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.421128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.422051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.422337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.423077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] PATH_INFO: `/v3/projects/25dd0563b362436db54f10ce235a581b/users/58f3096986f9452395a1cab8adb0316c/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.425755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:38.431159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 945/1921] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:38.439817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.442080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.445013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dd0563b362436db54f10ce235a581b, user_id=58f3096986f9452395a1cab8adb0316c, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.447923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.479393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 977/1922] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:38 2022] PUT /identity/v3/projects/25dd0563b362436db54f10ce235a581b/users/58f3096986f9452395a1cab8adb0316c/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:38.481379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.497396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:38.526567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019592-ede1-4f4f-9c82-a1381410e27b None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.591349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2ca8-8ba3-4c08-bf8f-c81d5e7a1448 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.599777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.600483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.600955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.601061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.601808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.603482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.613036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.613798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.613977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.614259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.620977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 978/1923] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:38.622088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.627608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.629520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab388-eae8-4cab-ae92-56c8a8c57721 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.637151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e576b3-80e3-438a-9699-102d98ce1eab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:38.641452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 946/1924] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:38.643799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:38.645096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.645716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.646275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] PATH_INFO: `/v3/projects/25dd0563b362436db54f10ce235a581b/users/58f3096986f9452395a1cab8adb0316c/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.649109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dd0563b362436db54f10ce235a581b, user_id=58f3096986f9452395a1cab8adb0316c, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:38.652649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:38.681619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 979/1925] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:38 2022] PUT /identity/v3/projects/25dd0563b362436db54f10ce235a581b/users/58f3096986f9452395a1cab8adb0316c/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:38.684944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:38.685237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:38.685512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:38.765210 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] MFA Rules not processed for user `58f3096986f9452395a1cab8adb0316c`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:38.766991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:38.901423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 947/1926] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:38.913138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:38.915020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.022328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4e98-5abc-4676-b240-f74e825930a8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.030845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.033135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.033597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.034262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.052182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.054948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.083269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 980/1927] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:39.205024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:39.207175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.224122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e57ba-84cf-43e1-94c6-300648d8500f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.229926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.230870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.231732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.232176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.234391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.291684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:39.293508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.340568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.343515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeed4b-cb1c-43c1-8b9c-887788f6fbf6 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.362990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 948/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:39.391388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36b98-68b7-40f8-aeef-0c575b2ab831 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.402178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.403084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.403372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.403649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] PATH_INFO: `/v3/projects/740cd07c5fd34c749334d206ad01700a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.404872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740cd07c5fd34c749334d206ad01700a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.406915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.413520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b328d-23bb-4d8d-96a9-03aad272d1bb None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.413808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b328d-23bb-4d8d-96a9-03aad272d1bb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.414097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b328d-23bb-4d8d-96a9-03aad272d1bb None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.419402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:39.421473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 949/1929] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:31:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:31:39.437115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.437115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.437115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.471473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:39.473660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.496830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:39.505490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740cd07c5fd34c749334d206ad01700a', 'request_id': 'req-07ee7905-c1f5-4893-9b1f-a991ab310708'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.550311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740cd07c5fd34c749334d206ad01700a', 'request_id': 'req-07ee7905-c1f5-4893-9b1f-a991ab310708'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.568513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740cd07c5fd34c749334d206ad01700a', 'request_id': 'req-07ee7905-c1f5-4893-9b1f-a991ab310708'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.586501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 950/1930] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:39.590745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] The token cache is being invalidate because project 740cd07c5fd34c749334d206ad01700a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:39.591547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.592317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.594677 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 981/1931] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:39 2022] DELETE /identity/v3/projects/740cd07c5fd34c749334d206ad01700a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:39.612351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:39.637914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:39.639396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.676185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7905-c1f5-4893-9b1f-a991ab310708 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.687320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.688423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.689000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.689382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.692050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.712986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.715453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.726834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5bc6-41c4-4ed2-8549-1e96de33c5af None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.736041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.737047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.737288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.737537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] PATH_INFO: `/v3/users/9feab07aaec9423da86c58a0017db4c6` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.739456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9feab07aaec9423da86c58a0017db4c6)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.741810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.744204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 982/1932] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:39.801000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:39.802680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:39.814229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9feab07aaec9423da86c58a0017db4c6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.817670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da1207-02b1-40ba-9987-242a1c66860e service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:39.822961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:39.824196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.824482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.824762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] PATH_INFO: `/v3/users/01802fca5f4e41679389d00514ae6243` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.826027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01802fca5f4e41679389d00514ae6243)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:39.828604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:39.829757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9feab07aaec9423da86c58a0017db4c6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.830572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9feab07aaec9423da86c58a0017db4c6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.858034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9feab07aaec9423da86c58a0017db4c6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.858998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d7d00b3-47cb-4940-bc18-e9849eeb1734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9feab07aaec9423da86c58a0017db4c6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.879238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 951/1933] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:39 2022] DELETE /identity/v3/users/9feab07aaec9423da86c58a0017db4c6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:39.888721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01802fca5f4e41679389d00514ae6243'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.902590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01802fca5f4e41679389d00514ae6243'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.903715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01802fca5f4e41679389d00514ae6243'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.914505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01802fca5f4e41679389d00514ae6243'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.915875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01802fca5f4e41679389d00514ae6243'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:39.937444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 983/1934] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:39 2022] DELETE /identity/v3/users/01802fca5f4e41679389d00514ae6243 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:39.942493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:39.942877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:39.943216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:39.970523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:39.972693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.001704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:40.053321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 952/1935] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:40.068502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.071101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.136547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8133-1ff1-4502-83c8-41b2376b91f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.140193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.140855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.141141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.141417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.150807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.152430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d8870-80ac-4738-bdad-46a82c21f0a9 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.157590 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:40.164321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 984/1936] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:40.190742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.192955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.223104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaddc2-b482-46eb-b206-47d0a5031fdb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.228918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.229927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.230149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.230452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] PATH_INFO: `/v3/projects/17161e4ad56848158ca50ed39071fab2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.232157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17161e4ad56848158ca50ed39071fab2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.234817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.296017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17161e4ad56848158ca50ed39071fab2', 'request_id': 'req-4f568744-e96c-43d1-ab1a-a67e192a7397'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:40.312372 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17161e4ad56848158ca50ed39071fab2', 'request_id': 'req-4f568744-e96c-43d1-ab1a-a67e192a7397'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:40.329184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17161e4ad56848158ca50ed39071fab2', 'request_id': 'req-4f568744-e96c-43d1-ab1a-a67e192a7397'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:40.341632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] The token cache is being invalidate because project 17161e4ad56848158ca50ed39071fab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:40.342242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:40.343911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f568744-e96c-43d1-ab1a-a67e192a7397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:40.348453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 953/1937] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:40 2022] DELETE /identity/v3/projects/17161e4ad56848158ca50ed39071fab2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:40.350443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.350730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.351048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.374728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:40.376321 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.469142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 985/1938] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:40.477834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.478167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.479136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.498963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:40.500652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.519640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 954/1939] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:40.523778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.542922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a620a5-e51f-4123-a74a-4bcdf41da04f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.555233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.556125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.556406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.556712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.557582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:40.557966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.559577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.573401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 986/1940] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:40.578687 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.589990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299af9c-105f-4cee-ad34-b73f28a8c578 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.595539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.596517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.596803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.597078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.598054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.600047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.633076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 955/1941] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:40 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:40.637951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.649620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4166de5-8964-4491-b674-128bfea327e7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.722249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.722965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.723366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.723737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.724586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.726508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.750601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 987/1942] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:40 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:40.755707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.767281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e16674-9ca6-4d9b-808c-725bed0d7942 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.771903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.772594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.772863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.773143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.774029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.775939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.788125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 956/1943] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:40.792812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.809410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb35c-0a5b-4266-8cdb-e6be6b88660f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.822263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.823405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.823708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.824108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.825000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.828521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.842954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 988/1944] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:40.846024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.856665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82f8e-062b-444f-878f-98ab5aa13bbc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.862738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:40.863696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.864031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.864311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] PATH_INFO: `/v3/projects/a542605ce07a43d2ba58dc28d74a8ac8/users/bce14ad3b27b4ca18ee75dbae1db0618/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.898495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a542605ce07a43d2ba58dc28d74a8ac8, user_id=bce14ad3b27b4ca18ee75dbae1db0618, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:40.902371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237af3-46d6-4414-9749-bf5b7ef197ea admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:40.914346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:40.916509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:40.929248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 957/1945] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:40 2022] PUT /identity/v3/projects/a542605ce07a43d2ba58dc28d74a8ac8/users/bce14ad3b27b4ca18ee75dbae1db0618/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:40.930972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34143-e521-41e4-81ee-3f0728668919 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:40.941714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:40.942009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:40.942283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:40.994685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] MFA Rules not processed for user `bce14ad3b27b4ca18ee75dbae1db0618`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:40.996223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.063004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.063922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.064207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.064485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] PATH_INFO: `/v3/projects/05dfe93925d7420690fdc60c744b8f68` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.066440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dfe93925d7420690fdc60c744b8f68)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.071747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.092701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:41.096889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:41.155219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 958/1946] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:41.161009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.181487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426514d3-f2df-4c83-9a3f-81fd3fbee4c9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.184070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dfe93925d7420690fdc60c744b8f68', 'request_id': 'req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.209259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dfe93925d7420690fdc60c744b8f68', 'request_id': 'req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.237680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dfe93925d7420690fdc60c744b8f68', 'request_id': 'req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.255312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] The token cache is being invalidate because project 05dfe93925d7420690fdc60c744b8f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:41.255312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.256257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.259067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 989/1947] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:40 2022] DELETE /identity/v3/projects/05dfe93925d7420690fdc60c744b8f68 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:41.263050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.265019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.278916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.280484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.280817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.281112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.281941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.284070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.318328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 959/1948] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:41 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:41.321358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.323271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.358598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad6f8-01c2-4dbe-a9e6-0167fde4080e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.395953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99860-7c79-4be0-a701-87d109f669e1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.400828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.401531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.401812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.402083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.402992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.405186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.430814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 960/1949] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:41 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:41.431794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.433124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.433466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.433766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] PATH_INFO: `/v3/users/58f3096986f9452395a1cab8adb0316c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.434195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.435549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f3096986f9452395a1cab8adb0316c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.437793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.444426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952784d-59d1-4fe9-80d2-d4e60bc535ab admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.449536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.450201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.450479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.450775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.451964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.453563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.464968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 961/1950] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:41.470817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.479591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c76aa-5348-4dca-9d07-2498e44b350e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.484605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.485281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.485568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.485846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.486574 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.488289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.496471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:41.498309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f3096986f9452395a1cab8adb0316c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.499963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 962/1951] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:41.504148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.514263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3f3-4e0d-449c-9f25-0a5c08fd17fe admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.516582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f3096986f9452395a1cab8adb0316c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.517288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f3096986f9452395a1cab8adb0316c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.519161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.520048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.520330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.520604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] PATH_INFO: `/v3/projects/570ba0ed2fa146e6a42422651c025695/users/b3b4831edbf04c4fb35bf7ba0f807736/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.524746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f3096986f9452395a1cab8adb0316c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.525461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd6b0bfd-a953-471a-b11e-7b04d8a8e6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f3096986f9452395a1cab8adb0316c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:41.536304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570ba0ed2fa146e6a42422651c025695, user_id=b3b4831edbf04c4fb35bf7ba0f807736, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.539136 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.539451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 990/1952] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:41 2022] DELETE /identity/v3/users/58f3096986f9452395a1cab8adb0316c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:41.554147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 963/1953] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:41 2022] PUT /identity/v3/projects/570ba0ed2fa146e6a42422651c025695/users/b3b4831edbf04c4fb35bf7ba0f807736/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:41.566342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.566641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.566960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.596780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] MFA Rules not processed for user `b3b4831edbf04c4fb35bf7ba0f807736`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:41.598058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.665780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 991/1954] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:41.670653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.672389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.681853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:41.746177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6cef-bcb0-450a-9556-f52b4cc99099 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.750838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.751523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.751803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.752078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.752806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.754729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.791230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 964/1955] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:41 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:41.795483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.807914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190c637-3ff7-4cc8-b7de-00944ff70c34 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.831303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.832823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:41.918021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.919936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.920222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.921861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.922950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.926427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.927463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd8dc-36a0-4c75-bd96-21f083ef48b4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.933349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.934515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.934955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.935329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] PATH_INFO: `/v3/projects/25dd0563b362436db54f10ce235a581b` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.936885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25dd0563b362436db54f10ce235a581b)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.940809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:41.956501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 992/1956] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:41 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:41.960774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:41.975467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c0cd-1395-4e3e-a428-ac02ad10cd8b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:41.982273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:41.983727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:41.984034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:41.984522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:41.985486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:41.987333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.003718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25dd0563b362436db54f10ce235a581b', 'request_id': 'req-527edb27-0cb1-4d69-b14c-26436df07514'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.014403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25dd0563b362436db54f10ce235a581b', 'request_id': 'req-527edb27-0cb1-4d69-b14c-26436df07514'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.017913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 993/1957] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:42.019190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.028380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25dd0563b362436db54f10ce235a581b', 'request_id': 'req-527edb27-0cb1-4d69-b14c-26436df07514'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.035600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578162-387e-4eb1-a275-6035e5233900 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.045331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] The token cache is being invalidate because project 25dd0563b362436db54f10ce235a581b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:42.045654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.046496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-527edb27-0cb1-4d69-b14c-26436df07514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.048506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 965/1958] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:41 2022] DELETE /identity/v3/projects/25dd0563b362436db54f10ce235a581b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:42.053095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95c88f-21a2-4b75-8bb8-dc3dab62e8fa None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.053431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95c88f-21a2-4b75-8bb8-dc3dab62e8fa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.053671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95c88f-21a2-4b75-8bb8-dc3dab62e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.072547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1e95c88f-21a2-4b75-8bb8-dc3dab62e8fa None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:42.074197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1e95c88f-21a2-4b75-8bb8-dc3dab62e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.077651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:42.096366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:42.130267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.131291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.131618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.131890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] PATH_INFO: `/v3/projects/f03958fa59644343aac087661862e0aa/users/4e0e896d0ce0422186cfee541ec0bddf/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.150260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03958fa59644343aac087661862e0aa, user_id=4e0e896d0ce0422186cfee541ec0bddf, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.153084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 966/1959] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:42.153381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.163945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.164318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.164516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.171116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 994/1960] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:42 2022] PUT /identity/v3/projects/f03958fa59644343aac087661862e0aa/users/4e0e896d0ce0422186cfee541ec0bddf/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:42.174808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.176474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.183400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:42.184569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.248270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 967/1961] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:42.252437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.258637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54d7f-4a31-4a3e-82c5-3dcf120cf891 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.262679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf8712-bac7-408f-9363-8c776a24c200 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.265165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.265863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.266168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.266432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.267402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.268765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.269629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.269788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.270218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.270631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.271520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:42.271931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.273656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.284850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 995/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:42.286119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 968/1963] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:31:42.290405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.290565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.301098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f73e-4e4c-426a-b601-b9edaaed6ef4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.301745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3875-2fd8-4402-a9a0-b77d41b0400a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.306184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.306418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.307352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.307480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.307693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.307897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.307984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] PATH_INFO: `/v3/projects/f03958fa59644343aac087661862e0aa/users/4e0e896d0ce0422186cfee541ec0bddf/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.308334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.309146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.310289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03958fa59644343aac087661862e0aa, user_id=4e0e896d0ce0422186cfee541ec0bddf, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.311465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.312932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eeed7-34c0-4413-ab46-1404a2b93453 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.328173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 996/1964] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:42 2022] PUT /identity/v3/projects/f03958fa59644343aac087661862e0aa/users/4e0e896d0ce0422186cfee541ec0bddf/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:42.338192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.338509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.338800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.350607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 969/1965] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:42.355175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.372735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] MFA Rules not processed for user `4e0e896d0ce0422186cfee541ec0bddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:42.373826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.434530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b3acd-659b-4bf3-9e53-dab62ef43e77 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.440395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.441085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.441365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.441638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.442336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.444673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.458986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 997/1966] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:42.473920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.473920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.479083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 970/1967] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:42.481768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.493032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb84-a08e-44fb-88d0-7b2fec1e4dfd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.498931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.499679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.499967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.500245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.501010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.502745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.509540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:42.514162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 971/1968] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:42.518505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.529795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f366-5f29-467f-9410-002288c64f5b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.535998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.536929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.537377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.537719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.538666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.540998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.542802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:42.543584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec652-8fa0-423e-aabc-188c055efdbb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.547806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.548593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.548937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.549290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.554087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.554243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 972/1969] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:42.555158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.557551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.569956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561d01-d503-4ad2-b68b-8a40328a8bf8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.575409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.576850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.577103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.577486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] PATH_INFO: `/v3/users/26727fa2ea1e4a49a8403a37cec29aab` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.578770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26727fa2ea1e4a49a8403a37cec29aab)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.580855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.615707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.617241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.626209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 998/1970] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:42.627099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.630382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26727fa2ea1e4a49a8403a37cec29aab'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.637106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c9be-dd4a-47ed-85a7-0f6c6fe3e0f1 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.641659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.642539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.642839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.643114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] PATH_INFO: `/v3/projects/b7af11ed64b446d1ac7485f86adc69a9/users/4df71e6c56d449bba0c29d3e89baca43/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.645330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26727fa2ea1e4a49a8403a37cec29aab'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.646050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26727fa2ea1e4a49a8403a37cec29aab'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.654435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26727fa2ea1e4a49a8403a37cec29aab'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.655143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-afb102ab-6d1b-46b8-b15e-45db63c45206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26727fa2ea1e4a49a8403a37cec29aab'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:42.659267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af11ed64b446d1ac7485f86adc69a9, user_id=4df71e6c56d449bba0c29d3e89baca43, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.662101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1c26-4d54-40f3-9faa-af91792f9df2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.671634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 973/1971] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:42 2022] DELETE /identity/v3/users/26727fa2ea1e4a49a8403a37cec29aab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:42.676821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.677112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.677533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.679250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 999/1972] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:42 2022] PUT /identity/v3/projects/b7af11ed64b446d1ac7485f86adc69a9/users/4df71e6c56d449bba0c29d3e89baca43/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:42.684219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.684512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.684795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.697723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:42.700181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.704487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:42.705796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.763036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 974/1973] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:42.778003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.779536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.782956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1000/1974] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:42.795968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:42.798037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:42.841217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66d0ec-49da-478c-b2ba-da84e67c7ab2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.846096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.846096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.846416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.846677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.857802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.859974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.870250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 975/1975] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:42.873131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fdeb-cb0e-4d30-8b24-fd78b6ece555 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:42.876885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:42.877546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:42.877869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:42.878097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:42.912992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:42.917659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:42.919843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:42.935330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1001/1976] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:43.791730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:43.793217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:43.815357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680f51-4a3a-41ee-a0f2-56924fb04ba5 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:43.827301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:43.831981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:43.833960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:43.834624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] PATH_INFO: `/v3/projects/4a85c11c9d6f482f99a79a2d7e12e46e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:43.839420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a85c11c9d6f482f99a79a2d7e12e46e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:43.844550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:43.867719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:43.948488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a85c11c9d6f482f99a79a2d7e12e46e', 'request_id': 'req-a62f075a-5a53-4f95-9ad7-8d1d62529d32'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:43.978577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a85c11c9d6f482f99a79a2d7e12e46e', 'request_id': 'req-a62f075a-5a53-4f95-9ad7-8d1d62529d32'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.005200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a85c11c9d6f482f99a79a2d7e12e46e', 'request_id': 'req-a62f075a-5a53-4f95-9ad7-8d1d62529d32'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.038922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] The token cache is being invalidate because project 4a85c11c9d6f482f99a79a2d7e12e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:44.038922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.047453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.052530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 976/1977] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:43 2022] DELETE /identity/v3/projects/4a85c11c9d6f482f99a79a2d7e12e46e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:44.053761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.070931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff6b4-b524-402c-944b-234a7524b377 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:44.185543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:44.185543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:44.185543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:44.185543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] PATH_INFO: `/v3/users/64026411c855409d97697a2b3ceb843f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:44.185909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64026411c855409d97697a2b3ceb843f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:44.185909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:44.243614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.245145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:44.262165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64026411c855409d97697a2b3ceb843f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.278366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64026411c855409d97697a2b3ceb843f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.279520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64026411c855409d97697a2b3ceb843f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.287550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64026411c855409d97697a2b3ceb843f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.288243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-41578237-73c4-4a2b-b271-69ba21620d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64026411c855409d97697a2b3ceb843f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.308056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1002/1978] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:44 2022] DELETE /identity/v3/users/64026411c855409d97697a2b3ceb843f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:44.311880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f075a-5a53-4f95-9ad7-8d1d62529d32 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:44.381710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:44.382524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:44.382952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:44.383303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:44.385511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:44.476879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:44.477160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:44.477450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:44.489403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:44.491000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:44.507670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] MFA Rules not processed for user `4df71e6c56d449bba0c29d3e89baca43`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:44.508905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:44.514107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 977/1979] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:44.618633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1003/1980] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:44.620649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.622304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:44.630851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:44.731513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.733990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:44.756463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:44.769017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ccfc-d7c2-4866-ad5c-d9bf092bd2ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:44.778984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6b2e-19c1-4f90-8796-8c6757cab8e7 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:44.781830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:44.784014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:44.784387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:44.784726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] PATH_INFO: `/v3/projects/c558b0b85358497d838f03f00b3c818a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:44.798947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c558b0b85358497d838f03f00b3c818a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:44.799891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:44.800828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:44.802648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:44.803558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:44.804907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:44.805961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:44.811548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:44.861495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 978/1981] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:44 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:44.873109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.928311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c558b0b85358497d838f03f00b3c818a', 'request_id': 'req-b991f3af-fefa-404a-a781-d6e55d105b05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.948879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c558b0b85358497d838f03f00b3c818a', 'request_id': 'req-b991f3af-fefa-404a-a781-d6e55d105b05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.960464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c558b0b85358497d838f03f00b3c818a', 'request_id': 'req-b991f3af-fefa-404a-a781-d6e55d105b05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.987224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] The token cache is being invalidate because project c558b0b85358497d838f03f00b3c818a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:44.987530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.988207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:44.990057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1004/1982] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:44 2022] DELETE /identity/v3/projects/c558b0b85358497d838f03f00b3c818a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:44.995750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:44.997308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:45.007684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee79fd-e225-4069-86e5-44c04e3841c0 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.078289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991f3af-fefa-404a-a781-d6e55d105b05 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.085646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.086563 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.086878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.087159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] PATH_INFO: `/v3/users/1ad9f23054fd4189838432c84879c1a6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.092818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad9f23054fd4189838432c84879c1a6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.094829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.130183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.130977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.131269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.131552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.132433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.134548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.181169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 979/1983] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:44 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:45.185511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.188153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:45.201960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad9f23054fd4189838432c84879c1a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:45.214871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5fd1-5d0f-4a13-8fc9-33424f9417d2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.228823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad9f23054fd4189838432c84879c1a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:45.229976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.230564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad9f23054fd4189838432c84879c1a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:45.234074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.234500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.237063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.237909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.240955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.245419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad9f23054fd4189838432c84879c1a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:45.246319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad9f23054fd4189838432c84879c1a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:45.269983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 980/1984] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:45.272539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.274961 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:45.280326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1005/1985] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:44 2022] DELETE /identity/v3/users/1ad9f23054fd4189838432c84879c1a6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:45.301379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394471dc-263f-4480-b162-ce31232682a1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.328988 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:45.399303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.401773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.403909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.404401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] PATH_INFO: `/v3/projects/c664391ce5aa4b27a558ea46403d8d90/users/0cb1849bf63b423c8fde7b126efdf783/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.428450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c664391ce5aa4b27a558ea46403d8d90, user_id=0cb1849bf63b423c8fde7b126efdf783, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.432382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.463585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 981/1986] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:45 2022] PUT /identity/v3/projects/c664391ce5aa4b27a558ea46403d8d90/users/0cb1849bf63b423c8fde7b126efdf783/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:45.467766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.483615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a36cb-37bf-483a-9fde-2c603c6fefe3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.489740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:45.609172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.610587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:45.635303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.636237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.636704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.637050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.638468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.641043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.657963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1006/1987] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:45.662629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.690195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2284c88-54dc-4a0f-981c-76aaf0962fc1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.707660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.710098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.710617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.711981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] PATH_INFO: `/v3/projects/c664391ce5aa4b27a558ea46403d8d90/users/0cb1849bf63b423c8fde7b126efdf783/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.718829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c664391ce5aa4b27a558ea46403d8d90, user_id=0cb1849bf63b423c8fde7b126efdf783, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.725636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.760786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1007/1988] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:45 2022] PUT /identity/v3/projects/c664391ce5aa4b27a558ea46403d8d90/users/0cb1849bf63b423c8fde7b126efdf783/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:45.761939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa087b6-ade7-4cf5-a799-10dd17145f30 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:45.841434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:45.842269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:45.842693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:45.843041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:45.845420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:45.916050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:45.917519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46412edd-38f2-4bc2-8bfa-04ffa286a952 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:45.928266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 982/1989] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:45.991216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:45.993942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:46.085446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b48be-bb93-456d-b94c-a24682f43295 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.091200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.092270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.092768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.093258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] PATH_INFO: `/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.094499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3dc78b796514ecc9e0e0d054824e9c5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.096470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.150139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3dc78b796514ecc9e0e0d054824e9c5', 'request_id': 'req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:46.158549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3dc78b796514ecc9e0e0d054824e9c5', 'request_id': 'req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:46.164467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3dc78b796514ecc9e0e0d054824e9c5', 'request_id': 'req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:46.176072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] The token cache is being invalidate because project b3dc78b796514ecc9e0e0d054824e9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:46.176360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:46.177057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-219c7fc6-d87f-4af2-b49a-33dcb2c48c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:46.178612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1008/1990] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:45 2022] DELETE /identity/v3/projects/b3dc78b796514ecc9e0e0d054824e9c5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:46.183784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.184158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.184461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.192492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:46.206452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:46.207790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:46.274972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 983/1991] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:46.277803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.278089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.278366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.303756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:46.305253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:46.315167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1009/1992] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:46.320325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.331194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416222-b75c-43b7-90b1-ffb6b4700433 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.335953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.336759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.337096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.337430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.338290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:46.338651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.340505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.353605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 984/1993] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:31:46.358623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.369314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6abf5e-7b3a-4a9c-bd07-3d94bd2be042 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.374100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.374883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.375183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.376076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.377046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.379198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.391134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:46.415650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1010/1994] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:46.420101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.433209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61256ee-76d1-45aa-86d6-047a66909ceb admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.527555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.528274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.528560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.528839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.529556 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.534488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.579780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 985/1995] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:46.585339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.601317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474000-742f-4f4e-8e78-3bd680292cc0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.608289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.609148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.609440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.609711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.610497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.612355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.632685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1011/1996] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:46.638070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.661568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db142-a91b-484f-ba70-5942e34ed142 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.671150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.672184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.672671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.673145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.675195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.677196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9e25f-7e07-4639-a258-7876c28138e5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.691997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 986/1997] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:46.696385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:46.708695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920960d-bb51-4c09-af5f-92e23caeafb4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:46.714915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:46.716466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.716957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.717452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] PATH_INFO: `/v3/projects/5220f5885cea40b9acf1b266b823914a/users/0f9b54450ac941fb91245e7679b1fbbb/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.803042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220f5885cea40b9acf1b266b823914a, user_id=0f9b54450ac941fb91245e7679b1fbbb, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:46.811102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394774a1-4777-4e66-8c0b-eb6d099725cc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:46.847530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1012/1998] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:46 2022] PUT /identity/v3/projects/5220f5885cea40b9acf1b266b823914a/users/0f9b54450ac941fb91245e7679b1fbbb/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:46.858631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.859856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.860284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:46.885453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:46.889008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:46.971625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136106fc-f32b-46c1-b48c-04daa64ec3bc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:46.971916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136106fc-f32b-46c1-b48c-04daa64ec3bc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:46.972169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136106fc-f32b-46c1-b48c-04daa64ec3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:47.010044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 987/1999] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:47.012532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-136106fc-f32b-46c1-b48c-04daa64ec3bc None None] MFA Rules not processed for user `0cb1849bf63b423c8fde7b126efdf783`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:47.020362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-136106fc-f32b-46c1-b48c-04daa64ec3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:47.021825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:47.028196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:47.053309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:47.132130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1013/2000] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:47.139913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603d39-7349-40fa-9133-a6beb2d51969 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:47.143586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbca81-3ba1-4ebe-ba23-5f3b73aee596 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:47.144088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbca81-3ba1-4ebe-ba23-5f3b73aee596 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:47.144456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbca81-3ba1-4ebe-ba23-5f3b73aee596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:47.150612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:47.151729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:47.151729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:47.154921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:47.168282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:47.170484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:47.170733 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-18bbca81-3ba1-4ebe-ba23-5f3b73aee596 None None] MFA Rules not processed for user `4df71e6c56d449bba0c29d3e89baca43`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:47.172007 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18bbca81-3ba1-4ebe-ba23-5f3b73aee596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:47.191244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 988/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:47.284743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1014/2002] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:47.310451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:47.313350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:47.515524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0b5a-0df8-49de-828b-60819b70b634 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:47.523434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:47.524970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:47.525426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:47.525923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:47.530974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:47.564624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:47.567283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:47.591435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 989/2003] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:49.113564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:49.114070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:49.114181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:49.159497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] MFA Rules not processed for user `0f9b54450ac941fb91245e7679b1fbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:49.161532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:49.223451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:49.296076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1015/2004] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:49.308519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:49.312418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:49.413734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ff128-1423-4575-85c2-1e82a7c7e1d8 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:49.419469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:49.420167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:49.420611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:49.420963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:49.432888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:49.434071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a644b5e-e191-4f5b-bc3e-a6734595e291 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:49.444808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 990/2005] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:50.173859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:50.175895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:50.190987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9568c-6c1e-4a44-82f8-92aa231e3410 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:50.195933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:50.197067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:50.197561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:50.198066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] PATH_INFO: `/v3/users/bce14ad3b27b4ca18ee75dbae1db0618` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:50.199437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce14ad3b27b4ca18ee75dbae1db0618)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:50.201967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:50.258189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce14ad3b27b4ca18ee75dbae1db0618'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.272759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce14ad3b27b4ca18ee75dbae1db0618'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.273456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce14ad3b27b4ca18ee75dbae1db0618'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.280480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce14ad3b27b4ca18ee75dbae1db0618'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.281097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce14ad3b27b4ca18ee75dbae1db0618'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.294457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1016/2006] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:50 2022] DELETE /identity/v3/users/bce14ad3b27b4ca18ee75dbae1db0618 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:50.299445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:50.299865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:50.300195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:50.318143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:50.319404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:50.359343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:50.381440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 991/2007] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:50.391300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:50.393021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:50.450135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31b96-bf12-4ee5-ad10-eda5fb42b39b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:50.454127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:50.454809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:50.455101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:50.455378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:50.465169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:50.466164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b20a-9733-4399-9a3c-b43c5ef4333d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:50.476818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1017/2008] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:50.812517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:50.814091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:50.827659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1f72-d85a-48d1-ba05-ed345b25fd4f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:50.836576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:50.837830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:50.838283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:50.838658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] PATH_INFO: `/v3/projects/a542605ce07a43d2ba58dc28d74a8ac8` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:50.840035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a542605ce07a43d2ba58dc28d74a8ac8)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:50.842183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:50.907062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a542605ce07a43d2ba58dc28d74a8ac8', 'request_id': 'req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.919029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a542605ce07a43d2ba58dc28d74a8ac8', 'request_id': 'req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.942164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a542605ce07a43d2ba58dc28d74a8ac8', 'request_id': 'req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.943350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] The token cache is being invalidate because project a542605ce07a43d2ba58dc28d74a8ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:50.943664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.944396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:50.946948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 992/2009] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:50 2022] DELETE /identity/v3/projects/a542605ce07a43d2ba58dc28d74a8ac8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:50.948483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:50.948771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:50.949056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:50.957932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:50.968447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:50.971862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] MFA Rules not processed for user `0f9b54450ac941fb91245e7679b1fbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:50.973830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:51.035940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:51.051853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1018/2010] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:51.080294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef8bd-b7c0-4b6b-a72b-48fc975dcb97 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:51.086148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:51.087277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:51.087667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:51.088006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] PATH_INFO: `/v3/users/b3b4831edbf04c4fb35bf7ba0f807736` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:51.089509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b4831edbf04c4fb35bf7ba0f807736)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:51.091895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:51.178263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b4831edbf04c4fb35bf7ba0f807736'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.199582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b4831edbf04c4fb35bf7ba0f807736'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.200187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b4831edbf04c4fb35bf7ba0f807736'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.204337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:51.214144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b4831edbf04c4fb35bf7ba0f807736'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.215654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b4831edbf04c4fb35bf7ba0f807736'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.235173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 993/2011] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:50 2022] DELETE /identity/v3/users/b3b4831edbf04c4fb35bf7ba0f807736 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:51.625320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:51.638223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224662bd-adc8-4ba6-aad9-74019933cb49 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:51.704215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:51.705247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:51.705527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:51.705802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] PATH_INFO: `/v3/projects/570ba0ed2fa146e6a42422651c025695` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:51.707277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570ba0ed2fa146e6a42422651c025695)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:51.709353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:51.777446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570ba0ed2fa146e6a42422651c025695', 'request_id': 'req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.787617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570ba0ed2fa146e6a42422651c025695', 'request_id': 'req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.804640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570ba0ed2fa146e6a42422651c025695', 'request_id': 'req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.818891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] The token cache is being invalidate because project 570ba0ed2fa146e6a42422651c025695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:51.819258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.819975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:51.821891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1019/2012] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:51 2022] DELETE /identity/v3/projects/570ba0ed2fa146e6a42422651c025695 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:51.825751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:51.827750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:51.845040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93ad2-ca76-4d64-94ec-732365cffc79 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:51.944323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:51.945386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:51.945707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:51.946145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] PATH_INFO: `/v3/users/4e0e896d0ce0422186cfee541ec0bddf` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:51.947750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0e896d0ce0422186cfee541ec0bddf)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:51.949965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:52.049853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0e896d0ce0422186cfee541ec0bddf'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.064694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0e896d0ce0422186cfee541ec0bddf'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.065475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0e896d0ce0422186cfee541ec0bddf'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.091133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0e896d0ce0422186cfee541ec0bddf'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.095517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6ee3ca5a-a4d2-4a53-a7e7-408f191927b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0e896d0ce0422186cfee541ec0bddf'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.133376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 994/2013] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:51 2022] DELETE /identity/v3/users/4e0e896d0ce0422186cfee541ec0bddf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:52.524649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:52.526266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:52.542049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc52b6-dc7a-4fcf-a8ad-e0a5c0ec1bf3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:52.602716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:52.603715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.603995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.604272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] PATH_INFO: `/v3/projects/f03958fa59644343aac087661862e0aa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.605491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03958fa59644343aac087661862e0aa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:52.607520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:52.645062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:52.666407 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03958fa59644343aac087661862e0aa', 'request_id': 'req-db0503ad-8d48-4f88-863d-ea9537d3c428'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.677348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03958fa59644343aac087661862e0aa', 'request_id': 'req-db0503ad-8d48-4f88-863d-ea9537d3c428'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.685143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03958fa59644343aac087661862e0aa', 'request_id': 'req-db0503ad-8d48-4f88-863d-ea9537d3c428'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.697910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] The token cache is being invalidate because project f03958fa59644343aac087661862e0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:52.698198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.698908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db0503ad-8d48-4f88-863d-ea9537d3c428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:52.700476 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1020/2014] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:52 2022] DELETE /identity/v3/projects/f03958fa59644343aac087661862e0aa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:52.705973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.706261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.706621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.733964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:52.735228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:52.799164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 995/2015] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:52.806993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.807288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.807566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.827250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:52.828494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:52.837082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1021/2016] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:52.841685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:52.847744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:52.851715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff33f8a-3227-4110-8768-9ea219ede7c5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:52.858378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:52.859517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.860172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.860558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.861360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:52.861816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:52.863523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:52.875990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 996/2017] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:52.880341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:52.892408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21abd8-75ea-4494-af96-39eafb722e51 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:52.897554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:52.898815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.899088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.899364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.900156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:52.903349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:52.905799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:52.907482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:52.920869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b8f5f-2889-4d10-b7c8-882b0de46379 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:52.927332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:52.928482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:52.928817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:52.929206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] PATH_INFO: `/v3/users/55d5704e54bf4e3ebaf8b75767b9cd7e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:52.930652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d5704e54bf4e3ebaf8b75767b9cd7e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:52.933983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:52.936500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1022/2018] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:52 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:52.940451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.011308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d5704e54bf4e3ebaf8b75767b9cd7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.026729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d5704e54bf4e3ebaf8b75767b9cd7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.027326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70806ca-1d82-4ef4-aabd-45368108a7d9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.027606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d5704e54bf4e3ebaf8b75767b9cd7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.032539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.033758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.034221 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.034572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.035776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.036023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d5704e54bf4e3ebaf8b75767b9cd7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.037498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e3e447f7-2abc-4fab-9b61-bbbc21b55824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d5704e54bf4e3ebaf8b75767b9cd7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.037897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.054049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 997/2019] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:52 2022] DELETE /identity/v3/users/55d5704e54bf4e3ebaf8b75767b9cd7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:53.059378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.059693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.061484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.065808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1023/2020] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:52 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:53.069703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.071365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.081706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:53.082998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.084981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde730f8-c0af-405c-8caf-e2016f806004 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.150352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 998/2021] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:53.160484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.161378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.161741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.161905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.162011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.162922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.163549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.164652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.182890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1024/2022] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:53.186602 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.197085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2800-6796-4633-a684-25deabb3c5af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.202208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.203002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.203286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.203556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.204297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.205959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.220450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1025/2023] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:31:53.221646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.231710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:53.239925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ed255-7633-45af-b88b-bbb10f3a5361 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.243656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e86f51-d836-45c2-a53e-9bd82d600cf6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.248519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.248676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.248807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.248947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.249222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.250359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.250928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.251313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] PATH_INFO: `/v3/projects/8d3316e63ceb4e15ab0b527230a4d5fb/users/7a97f85e2f214d538ca94d702469e287/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.271492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.273258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6715ec-14e5-46e8-b95f-26b7d5ef554a service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.289337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3316e63ceb4e15ab0b527230a4d5fb, user_id=7a97f85e2f214d538ca94d702469e287, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.290239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 999/2024] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:53.292284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.307703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1026/2025] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:53 2022] PUT /identity/v3/projects/8d3316e63ceb4e15ab0b527230a4d5fb/users/7a97f85e2f214d538ca94d702469e287/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:53.319962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.320218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.320512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.344653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:53.364865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] MFA Rules not processed for user `7a97f85e2f214d538ca94d702469e287`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:53.366205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.452798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1000/2026] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:53.464817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.466723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.528077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68db78-e6dd-4ca0-a75f-3772975a88d4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.531830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.532491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.532771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.533046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.542242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.543751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.553141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1027/2027] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:53.646966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.649472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:53.740347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514beed-7cb6-4667-a54e-e7aa23d9cbaa None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.745645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.746593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.746977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.747253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] PATH_INFO: `/v3/projects/57903da0d2dd43a29308e277ca9a0928` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.748465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57903da0d2dd43a29308e277ca9a0928)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.750466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:53.813867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57903da0d2dd43a29308e277ca9a0928', 'request_id': 'req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.828705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57903da0d2dd43a29308e277ca9a0928', 'request_id': 'req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.837180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57903da0d2dd43a29308e277ca9a0928', 'request_id': 'req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.854944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] The token cache is being invalidate because project 57903da0d2dd43a29308e277ca9a0928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:53.855517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.855863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:53.860374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1001/2028] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:53 2022] DELETE /identity/v3/projects/57903da0d2dd43a29308e277ca9a0928 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:53.861624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:53.873644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaaa8a-9669-4c21-9fb3-e3b8be5142ad service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:53.945794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:53.946919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:53.947275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:53.947638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] PATH_INFO: `/v3/users/f0ecf05022a4406ca86636e12b5a8048` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:53.948982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ecf05022a4406ca86636e12b5a8048)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:53.951512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:54.041330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ecf05022a4406ca86636e12b5a8048'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.062126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ecf05022a4406ca86636e12b5a8048'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.063053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ecf05022a4406ca86636e12b5a8048'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.077974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ecf05022a4406ca86636e12b5a8048'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.079790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e6a3ac6-7dc0-4c56-97f6-2fb0b6d8c08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ecf05022a4406ca86636e12b5a8048'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.092739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:54.098577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1028/2029] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:53 2022] DELETE /identity/v3/users/f0ecf05022a4406ca86636e12b5a8048 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:54.578227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:54.581314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:54.600149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87c09-0fdb-4a28-9df6-7bfacc5e1c89 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:54.628382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:54.682820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:54.683724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:54.684106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:54.684478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] PATH_INFO: `/v3/projects/58e3626fd7a140108ba99255dc521844` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:54.685788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e3626fd7a140108ba99255dc521844)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:54.688010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:54.748797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e3626fd7a140108ba99255dc521844', 'request_id': 'req-6dd43ab0-add0-4fae-b431-7a7ca1105355'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.756866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e3626fd7a140108ba99255dc521844', 'request_id': 'req-6dd43ab0-add0-4fae-b431-7a7ca1105355'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.763820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e3626fd7a140108ba99255dc521844', 'request_id': 'req-6dd43ab0-add0-4fae-b431-7a7ca1105355'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.774727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] The token cache is being invalidate because project 58e3626fd7a140108ba99255dc521844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:54.775073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.775731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6dd43ab0-add0-4fae-b431-7a7ca1105355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:54.777473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1002/2030] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:54 2022] DELETE /identity/v3/projects/58e3626fd7a140108ba99255dc521844 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:54.782364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:54.782914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:54.783264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:54.808024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:54.809266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:54.894210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1029/2031] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:54.903381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:54.903816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:54.903942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:54.922642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:54.923889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:54.933392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1003/2032] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:54.937657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:54.949056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155bf7d-4900-453e-a23e-9c31eb56f3a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:54.954537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:54.955287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:54.955572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:54.955849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:54.956593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:54.956904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:54.958521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:54.980648 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1030/2033] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:31:54.982246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:54.992973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba133-1404-4153-a304-d594aee83bc6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:54.997924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:54.998600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.000156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.000156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.000156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.002073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.031648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1004/2034] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:54 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:55.036310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.048004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa506-fedc-4a0d-a384-704b3ffaa3c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.111788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.113299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.113663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.113947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.114838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.116804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.141143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1031/2035] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:55 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:55.145112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.156037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57de3-6cd2-45af-b90e-2ccdbdbffde8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.161299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.162209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.162586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.163010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.163993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.165742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.180510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1005/2036] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:55.184694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.194838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097357df-d871-48fd-bacc-bdcdfc40ec33 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.199449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.200144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.200422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.200768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.201927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.203567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74e7f-45ff-4dcc-8b1a-07303cb7fc91 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.214708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1032/2037] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:55.218958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.228876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bbed8-e8b8-46f8-be5c-953777482670 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.233805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.234824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.235190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.235523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] PATH_INFO: `/v3/projects/45484a651f22435db124fcd0b9697078/users/3035e200adbc4a12ab3df2d73a36e26d/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.251497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] RBAC: Authorizing `identity:create_grant(project_id=45484a651f22435db124fcd0b9697078, user_id=3035e200adbc4a12ab3df2d73a36e26d, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.254313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.270201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1006/2038] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:55 2022] PUT /identity/v3/projects/45484a651f22435db124fcd0b9697078/users/3035e200adbc4a12ab3df2d73a36e26d/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:55.281814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.282339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.282697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.320501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] MFA Rules not processed for user `3035e200adbc4a12ab3df2d73a36e26d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:55.321929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:55.391117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:55.406129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1033/2039] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:55.407228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.472823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:55.486341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53718-cfd6-4a91-91c9-64f2ad3e24de admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.493199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.493927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.495737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.495737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.495737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.497465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.529719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1007/2040] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:55 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:55.530999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.549934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf30e28-c30d-4fb3-9e57-bdba3d73e0ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.615770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.616690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.617092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.617424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.618232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.620507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.644137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1034/2041] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:55 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:55.648057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.659575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc5c5-4037-401d-86c9-41d1dddd852b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.664468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.665614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.665614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.665805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.666534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.668209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.683306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1008/2042] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:55.688015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.700584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fed58-e3c5-434c-9966-0754ac4d2959 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.706527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.707483 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.707766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.708043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] PATH_INFO: `/v3/projects/22eda9e57d144c1eaae88be36bba3693/users/2210c01a58204e1d8004b9826212c9e2/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.724668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22eda9e57d144c1eaae88be36bba3693, user_id=2210c01a58204e1d8004b9826212c9e2, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.728507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.758621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.759153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1035/2043] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:55 2022] PUT /identity/v3/projects/22eda9e57d144c1eaae88be36bba3693/users/2210c01a58204e1d8004b9826212c9e2/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:55.770948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed473c-5844-4eb7-806a-24cd1dd36f6a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.844429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.845200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.845484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.845757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.846488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.848141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42442e4-c7f5-4f5a-8f6f-1cab1987569f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.859193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1009/2044] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:55.864025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:55.889273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c56a7-42a4-495e-aad6-593be035a13b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:55.914943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:55.915984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.920831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.921158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] PATH_INFO: `/v3/projects/22eda9e57d144c1eaae88be36bba3693/users/2210c01a58204e1d8004b9826212c9e2/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:55.925614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22eda9e57d144c1eaae88be36bba3693, user_id=2210c01a58204e1d8004b9826212c9e2, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:55.929061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:55.960773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1036/2045] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:55 2022] PUT /identity/v3/projects/22eda9e57d144c1eaae88be36bba3693/users/2210c01a58204e1d8004b9826212c9e2/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:55.973361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:55.974714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:55.975054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:56.005724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] MFA Rules not processed for user `2210c01a58204e1d8004b9826212c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:56.007833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:56.147638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1010/2046] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:56.166365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:56.168079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:56.289039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202596e-1806-4f18-bdc9-5d0738c52a94 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:56.294297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:56.295477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:56.296008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:56.296504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:56.333903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:56.335874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82495470-ccd0-4d9f-88ec-584d0fed66ed service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:56.348681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1037/2047] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:56.423270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:56.424795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:56.514558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:56.541958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a886e2-2db7-4dad-b4be-5031adfe6d8e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:56.546575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:56.547684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:56.548069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:56.548533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] PATH_INFO: `/v3/users/7a97f85e2f214d538ca94d702469e287` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:56.549960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a97f85e2f214d538ca94d702469e287)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:56.552071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:56.622243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a97f85e2f214d538ca94d702469e287'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:56.640102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a97f85e2f214d538ca94d702469e287'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:56.640874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a97f85e2f214d538ca94d702469e287'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:56.649619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a97f85e2f214d538ca94d702469e287'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:56.650389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a97f85e2f214d538ca94d702469e287'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:56.669522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1011/2048] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:56 2022] DELETE /identity/v3/users/7a97f85e2f214d538ca94d702469e287 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:56.671752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:56.672046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:56.672335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:56.693098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:56.695888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:56.758961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:56.805929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1038/2049] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:31:56.850975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:56.852524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:56.969165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fcf-d073-49e8-87fb-708c9cf25777 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:56.973842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:56.975231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:56.975708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:56.976174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:56.987829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:56.989535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53eed-b4ea-4d93-a5cf-286468b94f24 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:57.001302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1012/2050] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:58.097197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.098695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.120546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f8d39-7971-493f-8128-1ebdcb376f84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.130768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.130768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.133278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.143115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] PATH_INFO: `/v3/projects/8d3316e63ceb4e15ab0b527230a4d5fb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.146753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3316e63ceb4e15ab0b527230a4d5fb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.149271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.254416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3316e63ceb4e15ab0b527230a4d5fb', 'request_id': 'req-c31ab544-4d94-479f-a900-dcfdaebcc4e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.263870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3316e63ceb4e15ab0b527230a4d5fb', 'request_id': 'req-c31ab544-4d94-479f-a900-dcfdaebcc4e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.271786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3316e63ceb4e15ab0b527230a4d5fb', 'request_id': 'req-c31ab544-4d94-479f-a900-dcfdaebcc4e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.285095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] The token cache is being invalidate because project 8d3316e63ceb4e15ab0b527230a4d5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:58.285294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.286121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c31ab544-4d94-479f-a900-dcfdaebcc4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.290871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1039/2051] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:58 2022] DELETE /identity/v3/projects/8d3316e63ceb4e15ab0b527230a4d5fb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:58.293359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.293811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.294099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.314794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:58.316222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.429509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1013/2052] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:58.431307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.431616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.431897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.445177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.449794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.476956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1cd6-26fb-4582-80e7-689f77632ac7 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.488274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.489203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.489488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.489766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] PATH_INFO: `/v3/users/3035e200adbc4a12ab3df2d73a36e26d` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.491857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:58.492894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3035e200adbc4a12ab3df2d73a36e26d)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.493102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.494983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.508244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:58.509659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1040/2053] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:58.514284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.524707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e61b-3982-42f1-97b7-305e14a674af None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.530027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.533219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.533492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.533766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.534527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:31:58.534880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.536521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.552096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1041/2054] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:31:58.557187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.572004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1565-148e-4bf1-970e-f94957009477 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.580304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.582000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.582615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.582738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.583494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.586711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.606545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3035e200adbc4a12ab3df2d73a36e26d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.631849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1042/2055] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:31:58 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:31:58.634516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3035e200adbc4a12ab3df2d73a36e26d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.636560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.637064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3035e200adbc4a12ab3df2d73a36e26d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.642201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.653315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3035e200adbc4a12ab3df2d73a36e26d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.654452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4f28b4e6-964b-49fd-ab87-0b68c4eeb698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3035e200adbc4a12ab3df2d73a36e26d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:58.689838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1014/2056] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:58 2022] DELETE /identity/v3/users/3035e200adbc4a12ab3df2d73a36e26d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:58.700076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.700690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.701543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.727378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:58.728735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.777363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b7abb-6c0c-41d7-9198-62993aecdb62 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.855557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:58.861253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1015/2057] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:58.879244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.880866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:58.898827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.899564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.899922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.900191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.901055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.902883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.928958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1043/2058] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:31:58 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:31:58.943783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:58.953929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e297-b0aa-44b4-8c0e-09e0a60e2b1a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.958127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.959076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.959562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.960008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.965565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8a144-79b5-4626-a07f-2ee3193102ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:58.975330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.979262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.980711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:58.981432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:58.981714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:58.981988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:58.984194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:58.987386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:58.996161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1016/2059] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:31:59.009471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1044/2060] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:59.013835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:59.025625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870636-f69e-465c-8e49-9da18ca57171 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:59.031699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:59.032391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:59.032671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:59.032947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:59.033679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:59.036472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528788-1b2d-4088-8a53-738e98594d94 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:59.053970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1017/2061] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:59.058480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:59.072812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17359-414f-4366-9521-e75ff576e1b6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:59.080292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:59.081303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:59.081645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:59.081987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] PATH_INFO: `/v3/projects/cac8e4f3ef2d4ede9cd8c4d6f4c223d0/users/eed6d87c79a549f88a4741e35b277669/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:59.101146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac8e4f3ef2d4ede9cd8c4d6f4c223d0, user_id=eed6d87c79a549f88a4741e35b277669, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:59.104115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:59.122899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1045/2062] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:31:59 2022] PUT /identity/v3/projects/cac8e4f3ef2d4ede9cd8c4d6f4c223d0/users/eed6d87c79a549f88a4741e35b277669/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:31:59.128911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:59.129209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:59.129681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:59.154306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:59.155698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:59.176989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:59.244252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1018/2063] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:59.264822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:59.361744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508ab2-fabc-4c5a-a8de-bd77501ccec2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:59.368397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:59.368893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:59.369363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:59.369636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:59.382513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:59.384980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:59.397127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1046/2064] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:59.692884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:59.694659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:59.710519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead4603-572d-4cc4-8105-ed1fbcefbf09 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:59.717034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:59.718427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:59.719156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:59.719685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] PATH_INFO: `/v3/projects/45484a651f22435db124fcd0b9697078` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:59.726132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45484a651f22435db124fcd0b9697078)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:59.729385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:59.881521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45484a651f22435db124fcd0b9697078', 'request_id': 'req-c6641900-117d-4d08-a2d3-a15a1f460f79'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:59.895348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45484a651f22435db124fcd0b9697078', 'request_id': 'req-c6641900-117d-4d08-a2d3-a15a1f460f79'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:59.906438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45484a651f22435db124fcd0b9697078', 'request_id': 'req-c6641900-117d-4d08-a2d3-a15a1f460f79'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:59.924179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] The token cache is being invalidate because project 45484a651f22435db124fcd0b9697078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:31:59.924843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:59.925798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c6641900-117d-4d08-a2d3-a15a1f460f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:31:59.928161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1019/2065] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:31:59 2022] DELETE /identity/v3/projects/45484a651f22435db124fcd0b9697078 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:31:59.944349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:59.963669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78624d-0637-4d30-8462-8dfb36549ec1 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:00.068694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:00.068694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:00.068694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:00.068694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] PATH_INFO: `/v3/users/2210c01a58204e1d8004b9826212c9e2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:00.069738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2210c01a58204e1d8004b9826212c9e2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:00.071966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:00.144018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:00.150179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2210c01a58204e1d8004b9826212c9e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:00.171239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2210c01a58204e1d8004b9826212c9e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:00.180143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2210c01a58204e1d8004b9826212c9e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:00.197610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2210c01a58204e1d8004b9826212c9e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:00.199299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2210c01a58204e1d8004b9826212c9e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:00.231652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1047/2066] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:31:59 2022] DELETE /identity/v3/users/2210c01a58204e1d8004b9826212c9e2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:00.867380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:00.868149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:00.868149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:00.890435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:00.892387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:00.915900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] MFA Rules not processed for user `eed6d87c79a549f88a4741e35b277669`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:00.919359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:00.991920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fe5b-a7b0-478c-a6c5-4ea3e04d976e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:00.996751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:00.997910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:00.998116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:00.998346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] PATH_INFO: `/v3/projects/22eda9e57d144c1eaae88be36bba3693` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:00.999599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22eda9e57d144c1eaae88be36bba3693)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.001560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.044699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1020/2067] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:01.056910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.058371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:01.072777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22eda9e57d144c1eaae88be36bba3693', 'request_id': 'req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:01.082312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22eda9e57d144c1eaae88be36bba3693', 'request_id': 'req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:01.089595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22eda9e57d144c1eaae88be36bba3693', 'request_id': 'req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:01.096491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:01.109184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] The token cache is being invalidate because project 22eda9e57d144c1eaae88be36bba3693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:01.110330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:01.111205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0e9a2f7-9e0b-4bec-bd8b-d0fecd816fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:01.112823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1048/2068] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:00 2022] DELETE /identity/v3/projects/22eda9e57d144c1eaae88be36bba3693 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:32:01.117702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1f6a-49a3-4f3a-bb71-441eceeb3a39 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.117996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1f6a-49a3-4f3a-bb71-441eceeb3a39 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.118280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1f6a-49a3-4f3a-bb71-441eceeb3a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.125917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6359b2-fe3a-4b2a-af80-9bb0185de91c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.137785 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-594e1f6a-49a3-4f3a-bb71-441eceeb3a39 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:01.139145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-594e1f6a-49a3-4f3a-bb71-441eceeb3a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:01.178814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.179497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.179785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.180096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.182002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:01.189013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:01.209326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1049/2069] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:32:01.217450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.217701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.217989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.239910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:01.241155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:01.249629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1050/2070] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:01.249818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.251327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.254094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.260480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1021/2071] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:01.263287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd700d-8e42-4e86-aaa5-745dffaaedb2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.268056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.268716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.269003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.269302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.270044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:01.270356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.272017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.285875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1051/2072] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:32:01.290273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.301175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783d8c-67fd-45c7-8b5a-19e2c3a9eba6 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.306488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.307187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.307464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.307733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.308422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.310308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.336102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1022/2073] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:32:01.340398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.350939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4770-7246-4878-869a-f2d120af7bb2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.407870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.408553 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.408832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.409105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.409808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.411829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.431273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1052/2074] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:01.435431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.447044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9b4ae-00e1-4676-bb80-8ff58c078df3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.452345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.453024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.453314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.453592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.454327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.455973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.467271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1023/2075] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:32:01.471505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.482454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94e58e-b196-4d91-bebe-82f6e70cf861 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.487842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.488526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.488810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.489085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.489861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.491522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f6645-04ea-4c86-b2ab-650e94d32276 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.505687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1053/2076] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:32:01.506964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.522241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ab175-674a-4125-a23b-068a742bf78b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.527513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.528435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.528723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.529010 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] PATH_INFO: `/v3/projects/be0f881bbc3b4fdab6285c7233b9eff2/users/778ebfd3e6a848baa2faa88736c5497a/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.545420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0f881bbc3b4fdab6285c7233b9eff2, user_id=778ebfd3e6a848baa2faa88736c5497a, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.548144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.568209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1024/2077] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:01 2022] PUT /identity/v3/projects/be0f881bbc3b4fdab6285c7233b9eff2/users/778ebfd3e6a848baa2faa88736c5497a/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:01.579510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.579797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.580100 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.609709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] MFA Rules not processed for user `778ebfd3e6a848baa2faa88736c5497a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:01.610967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:01.677863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1054/2078] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:01.684314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.744902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:01.767506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dfbd-3f0e-4c68-9947-b0f6a1542e5d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.778579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.778579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.778579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.778579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.779069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.779069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.805444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1025/2079] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:01.809683 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.820526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee830e-0ddb-4cef-ae05-56f4e23af1a2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.860612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:01.882276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.883002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.883284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.883653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.884232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.886168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.922240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1055/2080] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:01 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:01.923519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.939709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c530-b4bb-4ace-8483-9268e954210e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.945100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.945770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.946056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.946339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:01.947167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:01.948785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:01.962646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1026/2081] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:01.967120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:01.984004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ffe31-3464-40a5-85c7-ee128b2eb42c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:01.989303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:01.990350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:01.990706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:01.991078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] PATH_INFO: `/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da/users/75b9ce42fc264caaae67939867d42e7f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.012992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147d6ec864e4d0fbe3cb11eee1c82da, user_id=75b9ce42fc264caaae67939867d42e7f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.017182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.034016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1056/2082] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:01 2022] PUT /identity/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da/users/75b9ce42fc264caaae67939867d42e7f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:02.038158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:02.051273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f102-55c5-4aa9-879b-d7d2ea0e9541 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:02.123213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:02.124541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.124541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.124541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.125198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.127004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9694df-84fe-4720-b4c1-2e8a568234ce admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.139430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1027/2083] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:02.144001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:02.156828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db218-eeb6-4a7b-9736-5e55094f2f43 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:02.162205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:02.163366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.163898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.164387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] PATH_INFO: `/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da/users/75b9ce42fc264caaae67939867d42e7f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.166852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147d6ec864e4d0fbe3cb11eee1c82da, user_id=75b9ce42fc264caaae67939867d42e7f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.169660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.187017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1057/2084] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:02 2022] PUT /identity/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da/users/75b9ce42fc264caaae67939867d42e7f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:02.194580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.195197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.196304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.230417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] MFA Rules not processed for user `75b9ce42fc264caaae67939867d42e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:02.233463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:02.332675 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1028/2085] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:02.340825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:02.343217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:02.422326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560381-dcc9-4abf-bec8-14afb17e1a6e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:02.426492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:02.427229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.427514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.427822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.437986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.439638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20336d6-ec86-4246-b941-8c446e24dea4 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.451487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1058/2086] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:02.486978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:02.529573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:02.553386 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ce0f5-d4d6-4f1a-897b-9c436b5482eb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:02.560734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:02.560734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.560734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.560734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] PATH_INFO: `/v3/users/778ebfd3e6a848baa2faa88736c5497a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.563298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778ebfd3e6a848baa2faa88736c5497a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.566500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.628174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.628493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.628885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.646733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778ebfd3e6a848baa2faa88736c5497a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:02.648928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] MFA Rules not processed for user `eed6d87c79a549f88a4741e35b277669`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:02.650263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:02.659388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778ebfd3e6a848baa2faa88736c5497a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:02.660158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778ebfd3e6a848baa2faa88736c5497a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:02.668001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778ebfd3e6a848baa2faa88736c5497a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:02.668670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-71398bfc-a70b-4f0b-8f9e-cd910a019f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778ebfd3e6a848baa2faa88736c5497a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:02.691737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1029/2087] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:02 2022] DELETE /identity/v3/users/778ebfd3e6a848baa2faa88736c5497a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:02.697195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.697812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.698331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.720652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:02.722371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:02.730819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1059/2088] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:02.795699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1030/2089] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:02.802509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:02.803937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:02.844714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:02.864181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc3f1-5f53-4fd2-8f1d-98bb1d133d00 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:02.930216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:02.931142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:02.931438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:02.931716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:02.944115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:02.946165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:02.961627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1060/2090] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:04.131456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:04.132906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:04.149991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ab40-bfb0-49f0-bea0-a61d05fa318d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:04.158177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:04.159111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:04.159397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:04.159673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] PATH_INFO: `/v3/projects/be0f881bbc3b4fdab6285c7233b9eff2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:04.160950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0f881bbc3b4fdab6285c7233b9eff2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:04.162945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:04.227893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0f881bbc3b4fdab6285c7233b9eff2', 'request_id': 'req-23140d30-a607-442e-a639-5e73f2f966f5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.230890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:04.240132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0f881bbc3b4fdab6285c7233b9eff2', 'request_id': 'req-23140d30-a607-442e-a639-5e73f2f966f5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.251111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0f881bbc3b4fdab6285c7233b9eff2', 'request_id': 'req-23140d30-a607-442e-a639-5e73f2f966f5'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.264203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] The token cache is being invalidate because project be0f881bbc3b4fdab6285c7233b9eff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:04.264495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.265270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.267102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1031/2091] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:04 2022] DELETE /identity/v3/projects/be0f881bbc3b4fdab6285c7233b9eff2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:04.270946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:04.282190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b04e-f5ef-4a8f-8ef8-d8537c92a915 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:04.349311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:04.350352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:04.352440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:04.352440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] PATH_INFO: `/v3/users/75b9ce42fc264caaae67939867d42e7f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:04.353609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b9ce42fc264caaae67939867d42e7f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:04.356456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:04.420800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b9ce42fc264caaae67939867d42e7f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.437011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b9ce42fc264caaae67939867d42e7f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.439990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b9ce42fc264caaae67939867d42e7f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.454060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b9ce42fc264caaae67939867d42e7f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.455149 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2ef91e4f-a799-40d9-97d0-9d210efa4747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b9ce42fc264caaae67939867d42e7f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.478691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1061/2092] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:04 2022] DELETE /identity/v3/users/75b9ce42fc264caaae67939867d42e7f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:04.850944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:04.852491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:04.865740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23140d30-a607-442e-a639-5e73f2f966f5 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:04.925762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:04.926724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:04.928043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:04.928542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] PATH_INFO: `/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:04.930805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0147d6ec864e4d0fbe3cb11eee1c82da)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:04.932853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:04.986825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0147d6ec864e4d0fbe3cb11eee1c82da', 'request_id': 'req-0f239709-1ff5-4a82-b5e1-3ab6726a9077'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:04.995384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0147d6ec864e4d0fbe3cb11eee1c82da', 'request_id': 'req-0f239709-1ff5-4a82-b5e1-3ab6726a9077'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:05.002202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0147d6ec864e4d0fbe3cb11eee1c82da', 'request_id': 'req-0f239709-1ff5-4a82-b5e1-3ab6726a9077'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:05.013739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] The token cache is being invalidate because project 0147d6ec864e4d0fbe3cb11eee1c82da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:05.014031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:05.014877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0f239709-1ff5-4a82-b5e1-3ab6726a9077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:05.016691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1032/2093] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:04 2022] DELETE /identity/v3/projects/0147d6ec864e4d0fbe3cb11eee1c82da => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:05.023253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.023253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.023253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.043018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:05.044388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:05.053971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:05.108621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1062/2094] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:05.121017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.121393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.121779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.145052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:05.146261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:05.155343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1033/2095] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:05.159626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.169821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d0de-2742-4e9b-995b-4e9db9402142 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.175592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.176324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.176530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.176802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.177546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:05.177858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.179539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.192468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1063/2096] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:32:05.197226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.207322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f7165-9626-4ad5-83cc-ec3a4096da47 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.212562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.213221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.213504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.213780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.214469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.216422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.245609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1034/2097] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:05.252078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.265917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c567557-b4d4-43e0-b159-23527a968a55 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.343918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.344629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.344875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.345155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.345863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.347858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.370304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1064/2098] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:05.376377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.391693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966626b-d2f0-4047-95e3-4ddebc7fcd6f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.400389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.401757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.402116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.402409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.403546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.405830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.420296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1035/2099] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:05.424477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.435505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875aad-325d-4810-9372-7f8c6ef5fec8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.441294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.441966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.442251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.442511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.443282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.444905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7145a-a0ea-44d4-b445-41fb01ef4217 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.456080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1065/2100] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:05.460472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.471096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db42b-7757-4b95-ba5f-3e5a7a4e8df3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.475853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.476740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.477016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.477303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] PATH_INFO: `/v3/projects/474aa9ed05cc4e7d93828c78c2971929/users/bd85186b592c4280a6c4566eeb031068/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.492542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] RBAC: Authorizing `identity:create_grant(project_id=474aa9ed05cc4e7d93828c78c2971929, user_id=bd85186b592c4280a6c4566eeb031068, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.495544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.510164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1036/2101] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:05 2022] PUT /identity/v3/projects/474aa9ed05cc4e7d93828c78c2971929/users/bd85186b592c4280a6c4566eeb031068/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:32:05.520669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.520955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.521230 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.556778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] MFA Rules not processed for user `bd85186b592c4280a6c4566eeb031068`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:05.558152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:05.639564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1066/2102] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:05.644115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.654024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:05.722009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da962-6a69-4a4c-a6cb-f57f9828824a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.726967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.727902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.728441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.728818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.729588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.734104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.762810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1037/2103] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:05.765608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.776984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192cc82-ea4e-4f03-9352-00cc696df7ba None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.781850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:05.843351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.844132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.844489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.844834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.845603 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.847690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.874057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1067/2104] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:05 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:05.877937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.888361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72eaba-c296-437f-9641-2077c2a3fd51 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.893061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.893741 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.894025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.894304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.895065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.896670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.908079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1038/2105] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:05.912116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.922143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c672-409e-4eba-9551-ed569f048d67 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.927399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.928066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.928347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.928623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.929365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.931027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afbfea-e406-4e34-976c-ad8f141f10be admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.941246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1068/2106] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:05.945307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:05.956291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189bf1-a93c-4449-95fb-89b653a440b1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:05.961671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:05.962591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:05.962901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:05.963182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] PATH_INFO: `/v3/projects/504c97c186a14d098762456f3dc7c36e/users/b5821894ffac43738f17182728b0ce5a/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:05.978356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c97c186a14d098762456f3dc7c36e, user_id=b5821894ffac43738f17182728b0ce5a, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:05.981078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:05.996998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1039/2107] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:05 2022] PUT /identity/v3/projects/504c97c186a14d098762456f3dc7c36e/users/b5821894ffac43738f17182728b0ce5a/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:06.008211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.008501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.008780 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.037204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] MFA Rules not processed for user `b5821894ffac43738f17182728b0ce5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:06.038423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:06.116514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1069/2108] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:06.121433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.183888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29560-c557-4438-86b3-2964cf0a11fa admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.189044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.189793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.190150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.190551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.191342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.193209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.221120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1040/2109] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:06 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:06.225449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.236116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659249-ae76-4321-834c-4eb7c0458eaf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.296229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.296917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.297175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.297484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.298180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.300163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.321519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1070/2110] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:06 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:06.325639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.337062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bbec-4257-4698-bd9a-f2445323380b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.342848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.343521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.343799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.344067 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.344798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.346409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.358242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1041/2111] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:06.362743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.373652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759ed41-8e57-45de-93c6-4e90f9a7d081 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.379572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.380480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.380736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.381042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] PATH_INFO: `/v3/projects/e4f6f09a2dc24380bb4edbf057126974/users/2c2059f83f22473f816f6f246803dc23/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.383419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:06.398370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f6f09a2dc24380bb4edbf057126974, user_id=2c2059f83f22473f816f6f246803dc23, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.401104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.415689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1071/2112] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:06 2022] PUT /identity/v3/projects/e4f6f09a2dc24380bb4edbf057126974/users/2c2059f83f22473f816f6f246803dc23/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:06.419828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.430098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b23fd-1513-4dc1-8ff4-b4fd2629d546 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.460638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:06.489842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.490491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.490797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.491078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.491801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.493484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139571-8b81-4835-8067-0f8493b791db admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.503249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1042/2113] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:06.509642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.521286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4131-90f4-4a82-9d7b-a40a7c16f36e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.527381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.528280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.528557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.528830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] PATH_INFO: `/v3/projects/e4f6f09a2dc24380bb4edbf057126974/users/2c2059f83f22473f816f6f246803dc23/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.531115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f6f09a2dc24380bb4edbf057126974, user_id=2c2059f83f22473f816f6f246803dc23, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.533800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.545493 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1072/2114] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:06 2022] PUT /identity/v3/projects/e4f6f09a2dc24380bb4edbf057126974/users/2c2059f83f22473f816f6f246803dc23/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:06.556203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.556402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.556709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.585996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] MFA Rules not processed for user `2c2059f83f22473f816f6f246803dc23`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:06.587298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:06.672899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1043/2115] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:06.686552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.688902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:06.777972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e291-4cf6-4ed1-a963-db65942bc459 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.783863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.784754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.785120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.786087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:06.804776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:06.806331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:06.818457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1073/2116] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:06.908442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:06.921610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee93a1c-0bb0-42d3-afb1-5a80adbcabb2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:06.925552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:06.926635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:06.927093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:06.927402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:07.002042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:07.003643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8d2b-68a6-40c9-bd5a-57f3c1781890 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:07.013775 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1044/2117] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:09.923443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:09.989459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2ea9d-2c0a-449d-8dad-75105eec1cec service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:09.994438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:09.995386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:09.995707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:09.996106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] PATH_INFO: `/v3/users/bd85186b592c4280a6c4566eeb031068` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:09.997326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd85186b592c4280a6c4566eeb031068)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:10.000255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:10.055678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd85186b592c4280a6c4566eeb031068'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.084450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd85186b592c4280a6c4566eeb031068'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.085802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd85186b592c4280a6c4566eeb031068'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.103494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd85186b592c4280a6c4566eeb031068'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.104584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd85186b592c4280a6c4566eeb031068'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.106864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:10.127759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1074/2118] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:09 2022] DELETE /identity/v3/users/bd85186b592c4280a6c4566eeb031068 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:10.133061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:10.133061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:10.133651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:10.153794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:10.155004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:10.217598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:10.236333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1045/2119] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:32:10.246173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:10.247837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:10.310686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c6c3-3378-4830-8d06-b33180b86dc4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:10.314570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:10.315271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:10.315555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:10.315852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:10.325249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:10.327095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:10.336657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1075/2120] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:10.781252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:10.782804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:10.803148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8245-62c6-47c1-aea7-344cf226ce13 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:10.809927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:10.810937 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:10.811281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:10.811615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] PATH_INFO: `/v3/projects/474aa9ed05cc4e7d93828c78c2971929` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:10.815348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474aa9ed05cc4e7d93828c78c2971929)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:10.817758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:10.880366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474aa9ed05cc4e7d93828c78c2971929', 'request_id': 'req-ee6b889b-580b-4f39-bfd0-e210d4f69c39'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.889380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474aa9ed05cc4e7d93828c78c2971929', 'request_id': 'req-ee6b889b-580b-4f39-bfd0-e210d4f69c39'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.896844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474aa9ed05cc4e7d93828c78c2971929', 'request_id': 'req-ee6b889b-580b-4f39-bfd0-e210d4f69c39'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.907671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] The token cache is being invalidate because project 474aa9ed05cc4e7d93828c78c2971929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:10.907958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.908634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:10.910441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1046/2121] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:10 2022] DELETE /identity/v3/projects/474aa9ed05cc4e7d93828c78c2971929 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:10.914250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:10.924279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74e2-0fcd-43db-ba54-12fc8eb11b21 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:10.982075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:10.983010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:10.983274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:10.983580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] PATH_INFO: `/v3/users/b5821894ffac43738f17182728b0ce5a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:10.984831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5821894ffac43738f17182728b0ce5a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:10.986816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:11.038492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5821894ffac43738f17182728b0ce5a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.051823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5821894ffac43738f17182728b0ce5a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.052888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5821894ffac43738f17182728b0ce5a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.061461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5821894ffac43738f17182728b0ce5a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.062316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5821894ffac43738f17182728b0ce5a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.080969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1076/2122] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:10 2022] DELETE /identity/v3/users/b5821894ffac43738f17182728b0ce5a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:32:11.540663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:11.542699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:11.569274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b889b-580b-4f39-bfd0-e210d4f69c39 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:11.685963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:11.686955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:11.687237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:11.687559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] PATH_INFO: `/v3/projects/504c97c186a14d098762456f3dc7c36e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:11.688758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] RBAC: Authorizing `identity:delete_project(project_id=504c97c186a14d098762456f3dc7c36e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:11.691984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:11.754928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504c97c186a14d098762456f3dc7c36e', 'request_id': 'req-1d46ae97-f5c0-49f8-9a84-7ce10153947e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.764009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504c97c186a14d098762456f3dc7c36e', 'request_id': 'req-1d46ae97-f5c0-49f8-9a84-7ce10153947e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.770809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504c97c186a14d098762456f3dc7c36e', 'request_id': 'req-1d46ae97-f5c0-49f8-9a84-7ce10153947e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.782426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] The token cache is being invalidate because project 504c97c186a14d098762456f3dc7c36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:11.782716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.783494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.785093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1047/2123] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:11 2022] DELETE /identity/v3/projects/504c97c186a14d098762456f3dc7c36e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:11.789159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:11.790703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:11.804837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebba77-1ad1-48e2-8c7c-8fe1256d5a4d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:11.814308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:11.872389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:11.873206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:11.873523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:11.873827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] PATH_INFO: `/v3/users/2c2059f83f22473f816f6f246803dc23` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:11.875240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2059f83f22473f816f6f246803dc23)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:11.877200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:11.930077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2059f83f22473f816f6f246803dc23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.942685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2059f83f22473f816f6f246803dc23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.943514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2059f83f22473f816f6f246803dc23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.950459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2059f83f22473f816f6f246803dc23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.951473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8dd149e0-1a7d-4761-887b-5578e374bdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2059f83f22473f816f6f246803dc23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:11.965089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1077/2124] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:11 2022] DELETE /identity/v3/users/2c2059f83f22473f816f6f246803dc23 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:12.442555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:12.444108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:12.453661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:12.457672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae97-f5c0-49f8-9a84-7ce10153947e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:12.521887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:12.522761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:12.523114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:12.523384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] PATH_INFO: `/v3/projects/e4f6f09a2dc24380bb4edbf057126974` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:12.524933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f6f09a2dc24380bb4edbf057126974)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:12.527275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:12.582858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f6f09a2dc24380bb4edbf057126974', 'request_id': 'req-2643e810-acfd-46b4-b227-3357593b8f0c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:12.592494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f6f09a2dc24380bb4edbf057126974', 'request_id': 'req-2643e810-acfd-46b4-b227-3357593b8f0c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:12.600829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f6f09a2dc24380bb4edbf057126974', 'request_id': 'req-2643e810-acfd-46b4-b227-3357593b8f0c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:12.612698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] The token cache is being invalidate because project e4f6f09a2dc24380bb4edbf057126974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:12.612987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:12.613790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-2643e810-acfd-46b4-b227-3357593b8f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:12.615550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1048/2125] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:12 2022] DELETE /identity/v3/projects/e4f6f09a2dc24380bb4edbf057126974 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:12.621638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:12.622003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:12.622376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:12.648927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:12.650136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:12.718881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1078/2126] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:12.721281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:12.721622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:12.721821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:12.741183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:12.742428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:12.764802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1049/2127] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:12.769524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:12.797964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f31bd7-8b6a-4289-afab-82955dfd40d0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:12.797964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:12.801057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:12.801057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:12.801479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:12.802552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:12.802903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:12.804687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:12.849589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1079/2128] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:32:12.850938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:12.861946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f158-b3a3-49b3-9c4e-25b0a0f9ddda None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:12.867665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:12.868461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:12.869005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:12.869280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:12.870047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:12.872121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:12.926364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1050/2129] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:12 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:12.928332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:12.940730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebc2ae-ca75-4a01-8a1c-fcdf98b96c5a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:12.966577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:13.015406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.016098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.016554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.016980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.017924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.020688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.055877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1080/2130] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:12 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:13.058521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.069616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e8b61-3e4a-486e-856d-662bd4af201b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.078220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.079083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.079468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.079993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.081207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.082971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.101002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1051/2131] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:32:13.102215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.113842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf1d3-7cd9-4e48-9152-0d93a258d10a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.119909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.120707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.120992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.121270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.122159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.123774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339394fb-10d8-46b9-bbc4-4eda923c24ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.135564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1081/2132] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:13.139846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.154422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb306-b5f2-4b6d-85fc-ea85a03f6378 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.169166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.170205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.170560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.170950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] PATH_INFO: `/v3/projects/8284f8b925d144bab23edc29250c8715/users/e287c86d2b794a8893e0d2e1d20621f7/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.195193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8284f8b925d144bab23edc29250c8715, user_id=e287c86d2b794a8893e0d2e1d20621f7, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.198709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.220382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1052/2133] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:13 2022] PUT /identity/v3/projects/8284f8b925d144bab23edc29250c8715/users/e287c86d2b794a8893e0d2e1d20621f7/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:32:13.234524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.234689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.234887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.263017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] MFA Rules not processed for user `e287c86d2b794a8893e0d2e1d20621f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:13.264265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:13.344116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1082/2134] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:13.352467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.354250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:13.390693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:13.443073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123d12-878b-49ac-be2a-2eeb0c026442 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.448057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.449058 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.449605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.451388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.465162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.468446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60d74-7244-4515-b9c0-a112f7e6fba9 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.485026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1053/2135] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:13.511788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.592247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc23a3-f6d7-43de-831f-b8e286abf000 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.599525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.600960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.601387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.604447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] PATH_INFO: `/v3/users/e287c86d2b794a8893e0d2e1d20621f7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.606497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e287c86d2b794a8893e0d2e1d20621f7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:13.608655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:13.699259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:13.740858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e287c86d2b794a8893e0d2e1d20621f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:13.760368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e287c86d2b794a8893e0d2e1d20621f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:13.761246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e287c86d2b794a8893e0d2e1d20621f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:13.772823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e287c86d2b794a8893e0d2e1d20621f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:13.773754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e287c86d2b794a8893e0d2e1d20621f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:13.804194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1083/2136] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:13 2022] DELETE /identity/v3/users/e287c86d2b794a8893e0d2e1d20621f7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:13.809342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.809842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.810099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.828931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:13.830169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:13.898806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1054/2137] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:32:13.916761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:13.918718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:13.981388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac318a6-171e-4c21-817e-1372f6a53552 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:13.985626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:13.986292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:13.986614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:13.986911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:13.998895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:14.000372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcee333-114f-4fbb-a543-9b6db451d289 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:14.012006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1084/2138] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:14.791005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:14.792573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:14.821568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744dd0-92cf-4c59-8096-2aacc77510ae None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:14.827587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:14.828499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:14.828780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:14.829060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] PATH_INFO: `/v3/projects/8284f8b925d144bab23edc29250c8715` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:14.832644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8284f8b925d144bab23edc29250c8715)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:14.834597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:14.950547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8284f8b925d144bab23edc29250c8715', 'request_id': 'req-064d8d23-881c-426e-8c3e-790fe1ac54cd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:14.963666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8284f8b925d144bab23edc29250c8715', 'request_id': 'req-064d8d23-881c-426e-8c3e-790fe1ac54cd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:14.971997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8284f8b925d144bab23edc29250c8715', 'request_id': 'req-064d8d23-881c-426e-8c3e-790fe1ac54cd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:14.987363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] The token cache is being invalidate because project 8284f8b925d144bab23edc29250c8715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:14.987928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:14.988661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-064d8d23-881c-426e-8c3e-790fe1ac54cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:14.991104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1055/2139] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:14 2022] DELETE /identity/v3/projects/8284f8b925d144bab23edc29250c8715 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:14.996325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:14.996823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:14.997261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.019068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:15.020392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.091385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1085/2140] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:15.101966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.102261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.102546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.138269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:15.140198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.151270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1056/2141] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:15.157177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.171697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25666548-9d05-4bc0-b458-e5bf23b3524d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.178816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.179704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.180264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.180809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.181955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:15.182817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.184759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.209451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1086/2142] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:32:15.214397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.224543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a49ff-62dd-4d34-b2d1-117f55e182ff None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.236382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.237857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.238024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.238309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.239084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.241009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.267997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.270621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.273650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1057/2143] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:15 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:15.279863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.332580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:15.334917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:15.363084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd9ee-e31c-4f36-9a65-12c65f8a3bb9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.387436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd513-318c-44fd-9d9e-c95d51772273 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.395309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.396836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.397464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.398094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.399044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.404578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.425033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.425890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.426383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.426658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.429181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.437788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1058/2144] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:15 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:15.441828 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.463792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169a86-be69-42c6-8d5c-d492c4cdf1d6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.476478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.477255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.477541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.477818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.478658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.480259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.505457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1059/2145] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:15.509655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.525955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16ce2b-cc74-4401-8a9b-689751cd339d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.532239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.533095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.533384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.533660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.534539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.536398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.547427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1060/2146] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:15.553360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.568350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e778-5711-41b2-88ed-2da3ed3ff30e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.577510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.578806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.580290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.580672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.581072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] PATH_INFO: `/v3/projects/89a0b3188e5d433087b866c90be87b63/users/6433d1961732423a8bbb1079f5eeab22/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.582448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a631ad-b037-47cf-a648-21f453ed6b9a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.604174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a0b3188e5d433087b866c90be87b63, user_id=6433d1961732423a8bbb1079f5eeab22, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.606935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.613619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1087/2147] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:15.628628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1061/2148] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:15 2022] PUT /identity/v3/projects/89a0b3188e5d433087b866c90be87b63/users/6433d1961732423a8bbb1079f5eeab22/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:15.633525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.633818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.634099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.658005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:15.659274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.778832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1088/2149] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:15.792182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:15.794550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:15.860791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b10a-660c-4683-928b-8e43375e3534 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:15.864764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:15.865691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:15.866042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:15.866423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:15.876648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:15.878231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:15.889092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1062/2150] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:17.671993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:17.674662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:17.702763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8dbc-26fc-4349-8b4c-8c6ec442de75 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:17.712349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:17.713411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:17.713741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:17.714015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] PATH_INFO: `/v3/users/48b4223daa854dee846a0fd5518d1ff4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:17.717018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b4223daa854dee846a0fd5518d1ff4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:17.719521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:17.809656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:17.821503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b4223daa854dee846a0fd5518d1ff4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:17.846646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b4223daa854dee846a0fd5518d1ff4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:17.846646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b4223daa854dee846a0fd5518d1ff4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:17.860197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b4223daa854dee846a0fd5518d1ff4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:17.861141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10330906-4893-4ade-82b1-e2315116c31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b4223daa854dee846a0fd5518d1ff4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:17.884492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1089/2151] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:17 2022] DELETE /identity/v3/users/48b4223daa854dee846a0fd5518d1ff4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:18.347935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:18.387408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eca564-984e-4faf-9053-22a1ef2f5829 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:18.462546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:18.463664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.464054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.464399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] PATH_INFO: `/v3/projects/7167bacdd3df47d7b063fba7cf042afd` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.465726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7167bacdd3df47d7b063fba7cf042afd)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:18.468354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:18.488048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:18.525201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7167bacdd3df47d7b063fba7cf042afd', 'request_id': 'req-0dc5e355-8902-4570-9180-aa4cbe0f5367'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:18.534366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7167bacdd3df47d7b063fba7cf042afd', 'request_id': 'req-0dc5e355-8902-4570-9180-aa4cbe0f5367'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:18.542936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7167bacdd3df47d7b063fba7cf042afd', 'request_id': 'req-0dc5e355-8902-4570-9180-aa4cbe0f5367'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:18.556697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] The token cache is being invalidate because project 7167bacdd3df47d7b063fba7cf042afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:18.557187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:18.557942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0dc5e355-8902-4570-9180-aa4cbe0f5367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:18.559695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1063/2152] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:18 2022] DELETE /identity/v3/projects/7167bacdd3df47d7b063fba7cf042afd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:18.565107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.565412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.565695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.587175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:18.588786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:18.659124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1090/2153] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:18.663580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.663941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.664290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.685770 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:18.687474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:18.696012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1064/2154] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:18.700594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:18.712467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081660cf-3ecf-49b6-9fe6-d7723605e736 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:18.719011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:18.720135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.720759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.721245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.722080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:18.722836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:18.724039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:18.737094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1091/2155] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:32:18.741543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:18.753305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66369edd-34a6-4c0c-9a6f-bf4b5ba0d68c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:18.758258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:18.758981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.759262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.759585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.760673 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:18.762602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:18.821486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1065/2156] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:18 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:18.824059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:18.836355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d011c8d-d83c-4b9b-a2fe-661e50e47845 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:18.951719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:18.952673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:18.954444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:18.954940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:18.955863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:18.964069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:19.011413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1092/2157] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:18 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:19.014533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:19.049482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee0e2-2ad4-47e3-9a2c-60cd485fe3aa admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:19.064485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:19.065198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:19.065482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:19.065786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:19.071873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:19.073627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:19.109118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:19.111274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1066/2158] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:19.123003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded72be-ee92-4db2-b6e7-d23124c257d1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:19.135993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:19.137052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:19.137508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:19.137939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:19.139012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:19.140856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883b924-2818-4e49-9544-75c17a2d77e4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:19.159176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1093/2159] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:32:19.160531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:19.177014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c5d4d-4673-4ea3-9f0e-f7de75c2dfb0 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:19.182301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:19.184225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:19.184764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:19.185311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] PATH_INFO: `/v3/projects/4fd25453635947799916f1d4ce5b99cb/users/368d131be665431ab226f20011b38c7b/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:19.213654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd25453635947799916f1d4ce5b99cb, user_id=368d131be665431ab226f20011b38c7b, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:19.216971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:19.249143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749d23-8112-47f1-9a30-727a59a8b627 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:19.249594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749d23-8112-47f1-9a30-727a59a8b627 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:19.249964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749d23-8112-47f1-9a30-727a59a8b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:19.250872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1067/2160] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:19 2022] PUT /identity/v3/projects/4fd25453635947799916f1d4ce5b99cb/users/368d131be665431ab226f20011b38c7b/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:19.287598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3c749d23-8112-47f1-9a30-727a59a8b627 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:19.288898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3c749d23-8112-47f1-9a30-727a59a8b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:19.317883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:19.395026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1094/2161] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:19.424743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:19.428658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:19.524131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f0c7-6b6b-4e31-8643-24e62ad871bf admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:19.529981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:19.530825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:19.531200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:19.531563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:19.542224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:19.543843 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:19.558864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1068/2162] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:32:21.256420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe29bd-e060-4588-986d-a5115454916c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.256893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe29bd-e060-4588-986d-a5115454916c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.257102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe29bd-e060-4588-986d-a5115454916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.294720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-08fe29bd-e060-4588-986d-a5115454916c None None] MFA Rules not processed for user `6433d1961732423a8bbb1079f5eeab22`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:21.296414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-08fe29bd-e060-4588-986d-a5115454916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:21.388326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1095/2163] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:21.392896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:21.394471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:21.413982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4f5c-3b2a-40d0-9469-49725b64d331 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:21.420813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:21.421731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.422232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.422722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.423658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:21.426191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:21.459317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1069/2164] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:21 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:21.460665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe29bd-e060-4588-986d-a5115454916c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:21.473692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe29bd-e060-4588-986d-a5115454916c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:21.579939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:21.581252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.581765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.582270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.583397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:21.591410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:21.622730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1096/2165] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:21 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:32:21.628856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:21.643341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a710bc-250e-4bf4-855a-e05a6de0699f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:21.655953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:21.656652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.657087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.657271 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.657978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:21.659779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:21.679154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1070/2166] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:21.685918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:21.699740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07bbe-765e-4cef-bf8f-5c61315e3f6e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:21.705222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:21.706109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.706391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.706664 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] PATH_INFO: `/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc/users/fc8a3e45d0b647c7b4177832c87416bc/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.735639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47a84378ff841f88a8ba8b78c2ac2dc, user_id=fc8a3e45d0b647c7b4177832c87416bc, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:21.738479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:21.762370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1097/2167] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:21 2022] PUT /identity/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc/users/fc8a3e45d0b647c7b4177832c87416bc/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:21.764318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:21.827152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2138a8-8a23-40ae-acb5-15d0991a808a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:21.840600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:21.964593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:21.966546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:21.967075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:21.968219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:21.969237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:21.975265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626fae-e2e9-4ca0-a3b1-fd65bae11f32 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:22.007743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:22.010312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1071/2168] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:22.029578 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fcda-0c22-479d-a444-4aba350b6130 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:22.035280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:22.037244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:22.037696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:22.038259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] PATH_INFO: `/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc/users/fc8a3e45d0b647c7b4177832c87416bc/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:22.040758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47a84378ff841f88a8ba8b78c2ac2dc, user_id=fc8a3e45d0b647c7b4177832c87416bc, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:22.044469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:22.060770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1098/2169] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:22 2022] PUT /identity/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc/users/fc8a3e45d0b647c7b4177832c87416bc/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:32:28.070081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cbe5d-9ad7-42a7-9356-91ca4e169a18 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:28.070608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cbe5d-9ad7-42a7-9356-91ca4e169a18 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:28.070699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cbe5d-9ad7-42a7-9356-91ca4e169a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:28.158561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a50cbe5d-9ad7-42a7-9356-91ca4e169a18 None None] MFA Rules not processed for user `368d131be665431ab226f20011b38c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:28.160164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a50cbe5d-9ad7-42a7-9356-91ca4e169a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:28.278563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1072/2170] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:28.547192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:28.552021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:28.560924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:28.754530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d52df-cb9a-40b1-875b-6615356fb79b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:28.760873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:28.761935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:28.761935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:28.762151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:28.779317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:28.786639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a5bd-1771-4fd2-a7a9-1c43930617a6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:28.801635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1099/2171] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:31.289080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:31.289685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:31.289685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:31.359600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] MFA Rules not processed for user `0f9b54450ac941fb91245e7679b1fbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:31.369420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:31.420444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf2ca6-4f84-4e69-9d87-43ac00d1ea26 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:31.420444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf2ca6-4f84-4e69-9d87-43ac00d1ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:31.420444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf2ca6-4f84-4e69-9d87-43ac00d1ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:31.455127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f8bf2ca6-4f84-4e69-9d87-43ac00d1ea26 None None] MFA Rules not processed for user `368d131be665431ab226f20011b38c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:31.456346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8bf2ca6-4f84-4e69-9d87-43ac00d1ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:31.490068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1100/2172] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:31.521351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1073/2173] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:33.278113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5aad-aa82-4c42-923f-7d5a5934372f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:33.278682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5aad-aa82-4c42-923f-7d5a5934372f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:33.278682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5aad-aa82-4c42-923f-7d5a5934372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:33.329067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0e6c5aad-aa82-4c42-923f-7d5a5934372f None None] MFA Rules not processed for user `fc8a3e45d0b647c7b4177832c87416bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:33.330419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e6c5aad-aa82-4c42-923f-7d5a5934372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:33.511458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1101/2174] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:33.523829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:33.525519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:33.665091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:33.776823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375e184-4bd3-429e-adab-1c1e177db5b9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:33.784178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:33.784927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:33.785257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:33.785539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:33.911609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:33.914432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:33.938716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1074/2175] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:34.158598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:34.159152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:34.159432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:34.185568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:34.186920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:34.311967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1102/2176] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:32:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:34.362992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:34.364416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:34.487299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132d31-4fa1-42ab-9409-35feac49f7e5 service glance] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:34.494670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:34.495658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:34.496117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:34.497276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:34.511114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:34.513202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:34.524683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1075/2177] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:32:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:32:44.295547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:44.520628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=70 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:45.876773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:45.878441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:45.949556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1e91-f346-405d-ae6f-ed651c7f83a1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:45.954901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:45.956033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:45.956526 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:45.957928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] PATH_INFO: `/v3/users/4df71e6c56d449bba0c29d3e89baca43` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:45.970127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df71e6c56d449bba0c29d3e89baca43)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:45.976298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:46.064081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df71e6c56d449bba0c29d3e89baca43'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.077649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df71e6c56d449bba0c29d3e89baca43'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.078458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df71e6c56d449bba0c29d3e89baca43'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.088202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df71e6c56d449bba0c29d3e89baca43'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.089191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df71e6c56d449bba0c29d3e89baca43'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.115144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1103/2178] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:45 2022] DELETE /identity/v3/users/4df71e6c56d449bba0c29d3e89baca43 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:46.437451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:46.471544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9d993-0449-479d-832b-ed458b5dd973 service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:46.552275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:46.553258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:46.553755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:46.554437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] PATH_INFO: `/v3/projects/b7af11ed64b446d1ac7485f86adc69a9` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:46.556076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7af11ed64b446d1ac7485f86adc69a9)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:46.558640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:46.629575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7af11ed64b446d1ac7485f86adc69a9', 'request_id': 'req-f634ea1d-8020-4654-b339-f83d038e39c7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.639617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7af11ed64b446d1ac7485f86adc69a9', 'request_id': 'req-f634ea1d-8020-4654-b339-f83d038e39c7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.649526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7af11ed64b446d1ac7485f86adc69a9', 'request_id': 'req-f634ea1d-8020-4654-b339-f83d038e39c7'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.662537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] The token cache is being invalidate because project b7af11ed64b446d1ac7485f86adc69a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:46.663233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.664088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.666366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1076/2179] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:46 2022] DELETE /identity/v3/projects/b7af11ed64b446d1ac7485f86adc69a9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:46.670368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:46.671973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:46.686206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa4f5-bd41-4559-8c02-7194c84bffe6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:46.761907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:46.762876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:46.763229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:46.763576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] PATH_INFO: `/v3/users/0cb1849bf63b423c8fde7b126efdf783` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:46.764879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb1849bf63b423c8fde7b126efdf783)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:46.767039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:46.798036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:46.840859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb1849bf63b423c8fde7b126efdf783'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.865341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb1849bf63b423c8fde7b126efdf783'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.866156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb1849bf63b423c8fde7b126efdf783'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.875228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb1849bf63b423c8fde7b126efdf783'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.875890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6401569-623c-4714-8fa5-01a8b4db3454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb1849bf63b423c8fde7b126efdf783'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:46.893326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1104/2180] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:46 2022] DELETE /identity/v3/users/0cb1849bf63b423c8fde7b126efdf783 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:47.101227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:47.103232 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:47.141597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ea1d-8020-4654-b339-f83d038e39c7 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:47.351396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:47.362079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.362609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.363039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] PATH_INFO: `/v3/projects/c664391ce5aa4b27a558ea46403d8d90` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.364536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c664391ce5aa4b27a558ea46403d8d90)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:47.369733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:47.440276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:47.467906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c664391ce5aa4b27a558ea46403d8d90', 'request_id': 'req-93fc65a1-3605-4cec-8aba-f356e0b7bf59'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:47.489473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c664391ce5aa4b27a558ea46403d8d90', 'request_id': 'req-93fc65a1-3605-4cec-8aba-f356e0b7bf59'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:47.507413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c664391ce5aa4b27a558ea46403d8d90', 'request_id': 'req-93fc65a1-3605-4cec-8aba-f356e0b7bf59'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:47.544310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] The token cache is being invalidate because project c664391ce5aa4b27a558ea46403d8d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:47.544597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:47.549250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-93fc65a1-3605-4cec-8aba-f356e0b7bf59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:47.563393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1077/2181] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:47 2022] DELETE /identity/v3/projects/c664391ce5aa4b27a558ea46403d8d90 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:47.564200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.564504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.564772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.600258 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:47.601630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:47.685402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1105/2182] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:47.693829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.694112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.694390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.718562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:47.720462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:47.729744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1078/2183] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:47.738011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:47.749996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d226c-91e7-458b-bd60-e395f3cc6938 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:47.756012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:47.756688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.756968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.757257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.758015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:32:47.758406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:47.761723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:47.786820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1106/2184] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:32:47.791164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:47.805426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a741948-e328-40ea-9dc4-a5888bad0628 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:47.810492 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:47.811156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.811434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.811702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.812413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:47.814466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:47.844326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1079/2185] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:32:47 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:47.848670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:47.872263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1fea-5b0a-48a0-b5f7-135f370f5825 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:47.940699 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:47.941450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:47.941846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:47.942131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:47.942880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:47.944973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:47.978432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1107/2186] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:32:47 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:32:47.982595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:47.994420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc601-f0d0-4303-86f5-c808eddf487d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.000027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.000804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.001097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.001371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.002106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.003762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.015746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1080/2187] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:48.019928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:48.030627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3399279-19ef-488f-8899-23882e60cdeb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.035562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.036317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.036676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.037024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.038498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.039582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdfd02-22e9-425e-a2cb-551e1c23e104 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.050395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1108/2188] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:32:48.054756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:48.065656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2c46-e7dd-4cdb-b184-c6c73a67fa53 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.070600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.071579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.071842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.072164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] PATH_INFO: `/v3/projects/94054d4a14a5408fa8de37dcbda03be1/users/7f0dafcd183e4d63ab0d17eca0f88196/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.088639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94054d4a14a5408fa8de37dcbda03be1, user_id=7f0dafcd183e4d63ab0d17eca0f88196, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.091953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92384f85-1e80-4b4d-adfc-05c99041a759 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.107064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1081/2189] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:32:48 2022] PUT /identity/v3/projects/94054d4a14a5408fa8de37dcbda03be1/users/7f0dafcd183e4d63ab0d17eca0f88196/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:48.118608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.118969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.119263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.126687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:48.148099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] MFA Rules not processed for user `7f0dafcd183e4d63ab0d17eca0f88196`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:48.149337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:48.170571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.170884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.171157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.188229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] MFA Rules not processed for user `6433d1961732423a8bbb1079f5eeab22`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:48.189455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:48.216632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1109/2190] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:32:48.227830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:48.229455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:48.246809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1082/2191] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:32:48.288520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537735b-6aee-444e-84c3-2a5b6d2690d4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.292319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.292983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.293271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.293586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.302505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.304063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17fe2-6718-4735-994c-eb9265f0b6bc service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.315790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1110/2192] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:48.338629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:48.404660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71375f-42e9-489b-a96a-9498d8743690 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.409421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.410315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.410595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.410902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] PATH_INFO: `/v3/users/7f0dafcd183e4d63ab0d17eca0f88196` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.412163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0dafcd183e4d63ab0d17eca0f88196)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.414121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.416707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:48.480373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0dafcd183e4d63ab0d17eca0f88196'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:48.496116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0dafcd183e4d63ab0d17eca0f88196'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:48.496962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0dafcd183e4d63ab0d17eca0f88196'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:48.506538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0dafcd183e4d63ab0d17eca0f88196'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:48.507494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0dafcd183e4d63ab0d17eca0f88196'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:48.523822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1083/2193] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:32:48 2022] DELETE /identity/v3/users/7f0dafcd183e4d63ab0d17eca0f88196 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:48.528724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.529019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.529300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.547458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:32:48.548787 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:48.614222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1111/2194] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:32:48.625584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:48.632737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:48.694966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02303def-c9de-400e-9d31-b6cc35af45ec admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:48.698907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:48.699569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:48.699853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:48.700131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:48.709747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:48.711236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17f79b-8657-4124-bd19-90aa4eff1c7b service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:48.721219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1084/2195] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:32:49.205606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:32:49.207520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:32:49.226513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd51d1-9efd-4877-b70e-9c9bd25cb5c6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:32:49.236179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:32:49.239721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:32:49.240195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:32:49.240479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] PATH_INFO: `/v3/projects/94054d4a14a5408fa8de37dcbda03be1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:32:49.242881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94054d4a14a5408fa8de37dcbda03be1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:32:49.245101 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:32:49.284358 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:49.298172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94054d4a14a5408fa8de37dcbda03be1', 'request_id': 'req-86710080-fe86-45d0-84d7-a8d5a94e76fc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:49.306425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94054d4a14a5408fa8de37dcbda03be1', 'request_id': 'req-86710080-fe86-45d0-84d7-a8d5a94e76fc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:49.312110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94054d4a14a5408fa8de37dcbda03be1', 'request_id': 'req-86710080-fe86-45d0-84d7-a8d5a94e76fc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:49.324530 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] The token cache is being invalidate because project 94054d4a14a5408fa8de37dcbda03be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:32:49.324809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:49.325792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:32:49.327469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1112/2196] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:32:49 2022] DELETE /identity/v3/projects/94054d4a14a5408fa8de37dcbda03be1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:32:58.716836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:32:59.321402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:01.114397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871af9-1c47-43fb-9435-bb8e3b25979d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:01.114956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871af9-1c47-43fb-9435-bb8e3b25979d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:01.115034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871af9-1c47-43fb-9435-bb8e3b25979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:01.139012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c6871af9-1c47-43fb-9435-bb8e3b25979d None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:01.140417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c6871af9-1c47-43fb-9435-bb8e3b25979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:01.208502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1085/2197] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:01.221651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:01.223192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:01.297673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86710080-fe86-45d0-84d7-a8d5a94e76fc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:01.303938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:01.304607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:01.304884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:01.305148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:01.314278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:01.315951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:01.324226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1113/2198] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:33:02.611419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e685-8d6f-460a-9e75-0b21667f1fd3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:02.612001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e685-8d6f-460a-9e75-0b21667f1fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:02.612001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e685-8d6f-460a-9e75-0b21667f1fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:02.634085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ffe7e685-8d6f-460a-9e75-0b21667f1fd3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:02.636166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ffe7e685-8d6f-460a-9e75-0b21667f1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:02.704234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1086/2199] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:02.725118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:02.726962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:02.819497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b63a8-a128-4bbe-a9b4-3ffa64b2d493 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:02.828073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:02.828757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:02.829042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:02.829320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:02.838647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:02.840327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:02.850181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1114/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:12.695634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=52 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:12.845925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=66 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:25.264101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5296f6-9a96-4815-a2f1-4f9a96fec8f9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:25.265298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5296f6-9a96-4815-a2f1-4f9a96fec8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:25.265796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5296f6-9a96-4815-a2f1-4f9a96fec8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:25.284463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-fb5296f6-9a96-4815-a2f1-4f9a96fec8f9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:25.285848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fb5296f6-9a96-4815-a2f1-4f9a96fec8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:25.294541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1087/2201] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:25.343480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:25.352345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3123a30-683a-4617-b90c-7e5b4ab16be5 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:25.358918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:25.359694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:25.360115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:25.360456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:25.371395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:25.373082 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:25.383296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1115/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:32.710827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e5fa-7a2b-4658-97e6-9f64df5f8c55 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:32.711331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e5fa-7a2b-4658-97e6-9f64df5f8c55 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:32.711427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e5fa-7a2b-4658-97e6-9f64df5f8c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:32.738771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d3f5e5fa-7a2b-4658-97e6-9f64df5f8c55 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:32.740625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d3f5e5fa-7a2b-4658-97e6-9f64df5f8c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:32.751837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1088/2203] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:32.781212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:32.782830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:32.798558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5680ff-7aec-4aa8-8415-ab022ade6a7a service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:32.805679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:32.806576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:32.807042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:32.807466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:32.817020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:32.818662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:32.829429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1116/2204] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:33.841838 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1c24-1a00-4f79-8079-9d26338e83d2 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:33.842446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1c24-1a00-4f79-8079-9d26338e83d2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:33.842446 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1c24-1a00-4f79-8079-9d26338e83d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:33.861957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5bbf1c24-1a00-4f79-8079-9d26338e83d2 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:33.863239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5bbf1c24-1a00-4f79-8079-9d26338e83d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:33.870608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1089/2205] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:33:33.897869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:33.918296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973f7a-36d8-4cea-a010-24a802d913e9 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:33.926926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:33.928366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:33.928832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:33.929309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:33.940581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:33.942462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:33.955924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1117/2206] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:33:37.895480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68965-1678-427e-95f3-9380d1da705f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:37.896008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68965-1678-427e-95f3-9380d1da705f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:37.896109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68965-1678-427e-95f3-9380d1da705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:37.920123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-18b68965-1678-427e-95f3-9380d1da705f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:37.922020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-18b68965-1678-427e-95f3-9380d1da705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:37.951265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1090/2207] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:37.997285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:38.012546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5ae2-f5c2-4dc1-881e-b21c3faeafd8 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:38.020205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:38.021048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:38.021334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:38.021765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:38.031233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:38.033184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbaee8-22c3-4d8b-8768-4c0837c6904a service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:38.059624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1118/2208] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:42.763863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:42.764484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:42.764484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:42.784303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] MFA Rules not processed for user `c22bd4ec11c84c3c9f036664d992585d`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:42.785438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:42.849928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1091/2209] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:33:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:44.316678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:44.317465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:44.318197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:44.345524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:44.347400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:44.357730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1119/2210] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:44.388392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:44.406212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897e5fc-931f-4d69-96b2-1260468758aa None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:44.412850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:44.413626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:44.413994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:44.414465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:44.424475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:44.426512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2731ee4-844f-4554-a385-b337312f5a34 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:44.438911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1092/2211] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:45.036185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:45.037821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:45.125908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278ac9-dd42-491b-8da2-53229c1396b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:45.129909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:45.130588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:45.130900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:45.131181 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:45.133244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:45.207760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:45.209308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:45.220762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1120/2212] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:49.721508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645560d-fe3b-42e8-a149-abb10e9f5fb4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:49.722438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645560d-fe3b-42e8-a149-abb10e9f5fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:49.723066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645560d-fe3b-42e8-a149-abb10e9f5fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:49.758087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b645560d-fe3b-42e8-a149-abb10e9f5fb4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:49.761556 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b645560d-fe3b-42e8-a149-abb10e9f5fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:49.789444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1093/2213] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:50.067050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:50.093668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd0011-36c5-4ca9-ab84-d599d4f42b74 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:50.106743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:50.110400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:50.112193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:50.112879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:50.128643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:50.130282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:50.149851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1121/2214] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:53.527976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:53.528863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:53.529188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:53.535747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=47 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:53.549168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:53.550421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:53.557973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1094/2215] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:53.570980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:53.577102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:53.583879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6972a-0d57-4e0b-b500-a24651db7cea service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:53.589198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:53.589942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:53.590238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:53.590531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:53.599580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:53.601184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:53.609656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1122/2216] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:33:55.245209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:55.246732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:55.341898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3924-9dbc-4b7d-b706-caa063582ef9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:55.347294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:55.348017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:55.348302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:55.348585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:55.350551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:55.363193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:55.364835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:55.374865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1095/2217] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:55.817166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:55.818693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:55.833598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce587-449e-40c0-9317-dd5c34254872 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:55.838153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:55.839074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:55.839387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:55.839665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] PATH_INFO: `/v3/users/0f9b54450ac941fb91245e7679b1fbbb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:55.840864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9b54450ac941fb91245e7679b1fbbb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:55.842804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:55.892622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9b54450ac941fb91245e7679b1fbbb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:55.905975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9b54450ac941fb91245e7679b1fbbb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:55.906691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9b54450ac941fb91245e7679b1fbbb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:55.913902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9b54450ac941fb91245e7679b1fbbb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:55.914680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b2228af5-7a47-4958-a4a5-b11a043c2b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9b54450ac941fb91245e7679b1fbbb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:55.929480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1123/2218] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:33:55 2022] DELETE /identity/v3/users/0f9b54450ac941fb91245e7679b1fbbb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:56.114850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.126501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781aea-9822-4c17-bdf6-d5dbc84d511a service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.190532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.191526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.191811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.192086 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] PATH_INFO: `/v3/projects/5220f5885cea40b9acf1b266b823914a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.193275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5220f5885cea40b9acf1b266b823914a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.196310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.245383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5220f5885cea40b9acf1b266b823914a', 'request_id': 'req-650452f2-a3b8-4cbb-87ee-84cfb11c2762'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:56.254528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5220f5885cea40b9acf1b266b823914a', 'request_id': 'req-650452f2-a3b8-4cbb-87ee-84cfb11c2762'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:56.260922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5220f5885cea40b9acf1b266b823914a', 'request_id': 'req-650452f2-a3b8-4cbb-87ee-84cfb11c2762'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:56.271137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] The token cache is being invalidate because project 5220f5885cea40b9acf1b266b823914a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:33:56.271422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:56.272056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-650452f2-a3b8-4cbb-87ee-84cfb11c2762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:56.273609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1096/2219] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:33:56 2022] DELETE /identity/v3/projects/5220f5885cea40b9acf1b266b823914a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:56.278666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.279012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.279307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.297951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:56.299244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:56.362298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1124/2220] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:33:56.370225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.370520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.370861 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.389554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:56.391464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:56.400576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1097/2221] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:56.405062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.415546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d819ff-f79a-4bfd-b917-c72c6896c095 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.420311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.420981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.421269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.421547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.422325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:33:56.422635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.424308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.436252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1125/2222] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:33:56.440657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.450593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79002cb5-eebf-46e8-9c35-04de79fc6873 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.456116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.456796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.457077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.457348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.458053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.460041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.464654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:56.490842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1098/2223] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:33:56 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:33:56.495140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.505829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e434-f0bf-4738-93a2-d520aafda3ce admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.550812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:56.564969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.565653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.565939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.566249 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.566990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.568930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.592460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1126/2224] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:33:56 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:33:56.597017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.609022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e8ba-fb87-4afe-880b-dc965eaa85e4 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.615355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.616038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.616529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.617035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.618320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.620472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.630853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1099/2225] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:33:56.635264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.646207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b194-d796-4c6e-a873-d6b1e5f3833a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.652060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.652922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.653205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.653477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.654218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.656284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffb1fc-19e7-4bdc-a19b-030c993c74b3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.667325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1127/2226] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:33:56.671848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.682273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c9b52-ccb4-405d-b13b-12c87ed08931 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.688126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.689019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.689309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.689578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] PATH_INFO: `/v3/projects/e228dc1d873c44b2b97c7b14d6d0dfc5/users/da16eddae51f4173a0395277daba8544/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.707007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e228dc1d873c44b2b97c7b14d6d0dfc5, user_id=da16eddae51f4173a0395277daba8544, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.709711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.725926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1100/2227] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:33:56 2022] PUT /identity/v3/projects/e228dc1d873c44b2b97c7b14d6d0dfc5/users/da16eddae51f4173a0395277daba8544/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:56.736364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fc1-b9d0-43dc-811d-0e6416eecc68 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.736654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fc1-b9d0-43dc-811d-0e6416eecc68 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.736928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fc1-b9d0-43dc-811d-0e6416eecc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.767450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bdee0fc1-b9d0-43dc-811d-0e6416eecc68 None None] MFA Rules not processed for user `da16eddae51f4173a0395277daba8544`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:56.768655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bdee0fc1-b9d0-43dc-811d-0e6416eecc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:56.843267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1128/2228] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:56.855145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:56.856971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:56.922929 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3046-3c42-462c-abf7-c828ea6a5156 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:56.927924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:56.928591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:56.928874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:56.929122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:56.938435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:56.939931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130e983-63f4-461c-a072-793e8bb47e10 service glance] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:56.949627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1101/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:34:06.840184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:06.945150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:13.367823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:13.368326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:13.368548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:13.392025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] MFA Rules not processed for user `59a76b6656854ed6a845a451dfcc0185`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:13.393227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:13.454404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1129/2230] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:18.549971 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342654c-eea4-4a06-bdfe-640b114263ec None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:18.550469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342654c-eea4-4a06-bdfe-640b114263ec None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:18.550587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342654c-eea4-4a06-bdfe-640b114263ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:18.569936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4342654c-eea4-4a06-bdfe-640b114263ec None None] MFA Rules not processed for user `eed6d87c79a549f88a4741e35b277669`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:18.571173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4342654c-eea4-4a06-bdfe-640b114263ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:18.626323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1102/2231] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:23.446402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=25 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:27.141009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:27.228471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383de98-2e49-4260-b733-0fd6ad691c36 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:27.233268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:27.234227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:27.234643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:27.234958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] PATH_INFO: `/v3/users/da16eddae51f4173a0395277daba8544` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:27.236171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da16eddae51f4173a0395277daba8544)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:27.238143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:27.293842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da16eddae51f4173a0395277daba8544'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.306516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da16eddae51f4173a0395277daba8544'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.307254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da16eddae51f4173a0395277daba8544'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.314393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da16eddae51f4173a0395277daba8544'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.316182 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da16eddae51f4173a0395277daba8544'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.331150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1130/2232] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:34:27 2022] DELETE /identity/v3/users/da16eddae51f4173a0395277daba8544 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:34:27.335810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:27.336268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:27.336396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:27.354485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:27.355727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:27.419733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1103/2233] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:27.434513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:27.437159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:27.513326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e428d-4739-477c-8a84-ed93b99baeb9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:27.517840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:27.518511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:27.518804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:27.519102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:27.529457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:27.530976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e968d-206c-442a-bc42-e665304e288f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:27.543591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1131/2234] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:27.851743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:27.853547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:27.871749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d0c2-a4db-48e8-b2d7-d83f11e5a292 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:27.877565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:27.878448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:27.878736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:27.879049 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] PATH_INFO: `/v3/projects/e228dc1d873c44b2b97c7b14d6d0dfc5` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:27.880331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e228dc1d873c44b2b97c7b14d6d0dfc5)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:27.882303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:27.950187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e228dc1d873c44b2b97c7b14d6d0dfc5', 'request_id': 'req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.959014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e228dc1d873c44b2b97c7b14d6d0dfc5', 'request_id': 'req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.965730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e228dc1d873c44b2b97c7b14d6d0dfc5', 'request_id': 'req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.979743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] The token cache is being invalidate because project e228dc1d873c44b2b97c7b14d6d0dfc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:34:27.980056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.980693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-d5fcd86e-1afa-4dbf-852f-6e191e5e4301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:34:27.982279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1104/2235] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:34:27 2022] DELETE /identity/v3/projects/e228dc1d873c44b2b97c7b14d6d0dfc5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:34:27.987783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:27.988074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:27.988350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.006898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:28.008139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:28.026022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:28.071576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1132/2236] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:28.080363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.081160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.081649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.110844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:28.112094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:28.123789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1105/2237] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:34:28.125395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.136183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ca37-10e2-481c-be36-573c919a83d1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.142466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.143371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.143746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.144009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.147236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:34:28.147236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.147541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.159942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1133/2238] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:34:28.164476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.174054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f270c-d339-423b-8d92-ccd07c0142a6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.181579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.182243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.182525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.182824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.183527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.185471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.209172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:28.216747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1106/2239] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:34:28 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:34:28.222741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.235088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3993e-fb3e-4789-ae12-c273777f7dc4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.298444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.299168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.299458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.299763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.300492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.302491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.331058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1134/2240] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:34:28 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:34:28.337560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.353621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601bc7-7b5c-414f-a188-6c8b7c4abb32 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.360402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.361088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.361358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.361656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.362376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.364157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.375206 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1107/2241] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:34:28.379497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.389864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9dc9e-fbf4-42db-b35b-982c488b14a5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.394941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.395641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.395926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.396210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.396962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.398690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2731590-7a1d-4a95-8593-75c6022bda20 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.409491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1135/2242] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:34:28.413786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.426962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff255-4eaf-4804-afb5-49e7d92c25ae admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.432039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.432958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.433324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.433601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] PATH_INFO: `/v3/projects/71f237add76f452cb7c645c43b52fe37/users/d4fa0ccde7dc43fcbcfe5162952560bd/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.450349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f237add76f452cb7c645c43b52fe37, user_id=d4fa0ccde7dc43fcbcfe5162952560bd, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.453150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.473245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1108/2243] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:34:28 2022] PUT /identity/v3/projects/71f237add76f452cb7c645c43b52fe37/users/d4fa0ccde7dc43fcbcfe5162952560bd/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:34:28.487919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c14a-e064-4a34-b80c-d335c31396ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.488208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c14a-e064-4a34-b80c-d335c31396ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.488555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c14a-e064-4a34-b80c-d335c31396ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.522910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5889c14a-e064-4a34-b80c-d335c31396ef None None] MFA Rules not processed for user `d4fa0ccde7dc43fcbcfe5162952560bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:28.524203 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5889c14a-e064-4a34-b80c-d335c31396ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:28.592626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1136/2244] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:28.604281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:28.605977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:28.666009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04418d72-66c4-4dd0-bc12-f7d15512eff9 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:28.670335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:28.671009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:28.671317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:28.671594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:28.680794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:28.682225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:28.691655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1109/2245] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:38.589124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:38.687922 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:39.314138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17703-0bdf-43a3-8d29-62d2403769a2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:39.314352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17703-0bdf-43a3-8d29-62d2403769a2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:39.314645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17703-0bdf-43a3-8d29-62d2403769a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:39.340857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cde17703-0bdf-43a3-8d29-62d2403769a2 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:39.342076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cde17703-0bdf-43a3-8d29-62d2403769a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:39.409344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1137/2246] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:39.444662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:39.446102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:39.529915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c4755-18c6-41b6-82d2-e79caccb86ee service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:39.536567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:39.537231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:39.537501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:39.537774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:39.549600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:39.551403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:39.561498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1110/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:44.633757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711c27-3d10-40a8-b453-a3db23814c7a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:44.634317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711c27-3d10-40a8-b453-a3db23814c7a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:44.634317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711c27-3d10-40a8-b453-a3db23814c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:44.653898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3b711c27-3d10-40a8-b453-a3db23814c7a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:44.655271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b711c27-3d10-40a8-b453-a3db23814c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:44.664252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1138/2248] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:44.689836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:44.701471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117eb9-d82d-42c7-87f7-425cb6934b92 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:44.707330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:44.708077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:44.708424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:44.708765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:44.717783 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:44.719622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:44.729595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1111/2249] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:49.765122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be34f-3b5b-4629-97ac-6722c83d66eb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:49.766038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be34f-3b5b-4629-97ac-6722c83d66eb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:49.766323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be34f-3b5b-4629-97ac-6722c83d66eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:49.792410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-217be34f-3b5b-4629-97ac-6722c83d66eb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:49.793634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-217be34f-3b5b-4629-97ac-6722c83d66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:49.803159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1139/2250] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:49.832193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:49.833855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:49.849794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96c31-93a3-434b-8688-96ee40212f6d service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:49.856913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:49.857576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:49.857870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:49.858159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:49.866900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:49.868508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:49.878335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1112/2251] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:55.762515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977524-c6a1-4cfc-ac81-4da26918c88a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:55.763054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977524-c6a1-4cfc-ac81-4da26918c88a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:55.763054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977524-c6a1-4cfc-ac81-4da26918c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:55.784202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8f977524-c6a1-4cfc-ac81-4da26918c88a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:55.785424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f977524-c6a1-4cfc-ac81-4da26918c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:55.794759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1140/2252] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:55.860131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:55.876369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3f5a-cc66-473c-b7d3-431753e6bbe0 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:55.883708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:55.884355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:55.884621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:55.884893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:55.893720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:55.895296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:55.904894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1113/2253] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:01.286524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:01.287117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:01.287117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:01.306890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:01.308204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:01.317575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1141/2254] 10.222.0.52 () {58 vars in 1016 bytes} [Fri Jul 15 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:01.340644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:01.352233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b7e81-a400-4e88-bfc8-ec7c49d54c4b service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:01.358862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:01.359631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:01.359912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:01.360195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:01.369258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:01.370941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0663c7-8b50-4cd6-a130-52f34dae6991 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:01.380957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1114/2255] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:11.301911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=39 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:11.326735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:11.337220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783f75c-2f04-4832-83b3-197f239a83b4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:11.343104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:11.344017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:11.344298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:11.344570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] PATH_INFO: `/v3/users/d4fa0ccde7dc43fcbcfe5162952560bd` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:11.345908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fa0ccde7dc43fcbcfe5162952560bd)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:11.347917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:11.376336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=58 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:11.402944 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fa0ccde7dc43fcbcfe5162952560bd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.415450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fa0ccde7dc43fcbcfe5162952560bd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.416192 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fa0ccde7dc43fcbcfe5162952560bd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.423695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fa0ccde7dc43fcbcfe5162952560bd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.424376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fa0ccde7dc43fcbcfe5162952560bd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.438403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1142/2256] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:35:11 2022] DELETE /identity/v3/users/d4fa0ccde7dc43fcbcfe5162952560bd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:11.443181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:11.443471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:11.443903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:11.462449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:11.463700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:11.524392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1115/2257] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:11.534325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:11.535817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:11.597499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a813-9d31-450f-b320-0a11001874f7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:11.601531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:11.602200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:11.602491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:11.602767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:11.612209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:11.613669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dd45f-f189-489c-bec8-845127f1e960 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:11.623194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1143/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:11.908582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:11.910295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:11.925263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3435-3883-46b2-a82a-8906a8c78369 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:11.931912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:11.932875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:11.933118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:11.933394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] PATH_INFO: `/v3/projects/71f237add76f452cb7c645c43b52fe37` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:11.935339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f237add76f452cb7c645c43b52fe37)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:11.937328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:11.986213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f237add76f452cb7c645c43b52fe37', 'request_id': 'req-245002dc-8784-4ab9-9fcd-689a93fc72d1'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:11.994604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f237add76f452cb7c645c43b52fe37', 'request_id': 'req-245002dc-8784-4ab9-9fcd-689a93fc72d1'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:12.001441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f237add76f452cb7c645c43b52fe37', 'request_id': 'req-245002dc-8784-4ab9-9fcd-689a93fc72d1'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:12.014325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] The token cache is being invalidate because project 71f237add76f452cb7c645c43b52fe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:35:12.014622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:12.015385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-245002dc-8784-4ab9-9fcd-689a93fc72d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:12.017320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1116/2259] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:35:11 2022] DELETE /identity/v3/projects/71f237add76f452cb7c645c43b52fe37 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:12.022130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.022426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.022702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.041833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:12.043072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:12.107501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1144/2260] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:12.115565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.115859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.116659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.137964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:12.139222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:12.147400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1117/2261] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:12.152492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.167978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9f68-cae0-47cb-98a2-cde48d1cbc18 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.174142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.174808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.175115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.175385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.176112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:35:12.176459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.178081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.189845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1145/2262] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:35:12.194334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.204142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e2bf7-4858-4da6-b226-cef04bd560f1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.209166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.209844 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.210125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.210397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.211123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.213042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.241737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1118/2263] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:35:12.245953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.251058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:12.257464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23e6ca-6d07-4d31-9aa3-7dd0cc667c2d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.317520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.318144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.318417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.318691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.319405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.321365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.341839 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1146/2264] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:35:12.346007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.356380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f671f2-4546-4752-ac05-e01806dd370c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.361494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.362154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.362432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.362703 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.363463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.365079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.375706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1119/2265] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:35:12.379793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.390713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e2ea-a375-4e43-aee9-a989886da576 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.396425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.397114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.397391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.397647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.398387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.400030 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298828d-8652-46a7-84ca-d63892234202 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.410531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1147/2266] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:35:12.414742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.425157 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635501c8-3164-40cb-8faf-9b8a33fd5fe6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.430160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.431091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.431374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.431649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] PATH_INFO: `/v3/projects/6701e51ea1a8442db5e4632ef20a9bd2/users/a597e120452f466b810a498c089a1c01/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.447474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6701e51ea1a8442db5e4632ef20a9bd2, user_id=a597e120452f466b810a498c089a1c01, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.450532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.465557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1120/2267] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:35:12 2022] PUT /identity/v3/projects/6701e51ea1a8442db5e4632ef20a9bd2/users/a597e120452f466b810a498c089a1c01/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:12.476253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014ccc-dd92-4990-b817-7f4726794987 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.476629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014ccc-dd92-4990-b817-7f4726794987 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.476909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014ccc-dd92-4990-b817-7f4726794987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.504151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-13014ccc-dd92-4990-b817-7f4726794987 None None] MFA Rules not processed for user `a597e120452f466b810a498c089a1c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:12.505558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13014ccc-dd92-4990-b817-7f4726794987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:12.574738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1148/2268] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:12.585428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.587315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:12.610674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:12.648820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1965-d9fa-4857-958b-3363602abba8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:12.653041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:12.653699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.653985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.654263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.663427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:12.664881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f9ec2-b20d-4081-a67e-2d691da323f9 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:12.674413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1121/2269] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:15.150296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:15.150918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:15.150918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:15.170103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] MFA Rules not processed for user `a597e120452f466b810a498c089a1c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:15.171475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:15.179531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1149/2270] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:16.951890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882993-e257-4eb3-9d5c-0323232fa40f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:16.952343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882993-e257-4eb3-9d5c-0323232fa40f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:16.952447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882993-e257-4eb3-9d5c-0323232fa40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:16.970288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-58882993-e257-4eb3-9d5c-0323232fa40f None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:16.971672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-58882993-e257-4eb3-9d5c-0323232fa40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:17.031434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1122/2271] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:17.080632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:17.082091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:17.170615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469d6a-34af-468f-ab1f-d550d51f6dfa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:17.175802 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:17.176464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:17.176744 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:17.177106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:17.182726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:17.187974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:17.190747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c3cef-cfea-4940-8470-8e6f33a3fcaa service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:17.202089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1150/2272] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:27.024586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=42 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:27.197451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:35.064483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.065064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.065064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.066464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1123/2273] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:35.072251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42aea-d0c2-4bdc-8fd5-51181926732b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.073044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42aea-d0c2-4bdc-8fd5-51181926732b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.073169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42aea-d0c2-4bdc-8fd5-51181926732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.095849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b4f42aea-d0c2-4bdc-8fd5-51181926732b None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:35.097401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b4f42aea-d0c2-4bdc-8fd5-51181926732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.166591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1151/2274] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:35.179527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:35.181423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.245335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a9e3b-8813-41dc-84b9-0ef61766f2c2 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:35.250119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:35.250804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.251109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.251375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.262139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:35.263607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1f3f4-5733-4148-8c41-4a8e908d33d6 service glance] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:35.274508 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1124/2275] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:35.347448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.347748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.348028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.349429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1152/2276] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:35.354423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7075b-a869-448c-8364-ef1e41b61336 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.354716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7075b-a869-448c-8364-ef1e41b61336 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.355018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7075b-a869-448c-8364-ef1e41b61336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.377688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d7e7075b-a869-448c-8364-ef1e41b61336 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:35.379077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d7e7075b-a869-448c-8364-ef1e41b61336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.431543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1125/2277] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:35.444579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:35.446659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.462065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4223c-0ff3-4f45-87cd-f5fac84338cf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:35.466104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:35.466745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.467060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.467333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.475000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:35.476451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f948a12-7239-474f-a5aa-f0919b652c05 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:35.484350 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1153/2278] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:35.570387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01825-b885-4d47-a6eb-f9135b574f92 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.570711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01825-b885-4d47-a6eb-f9135b574f92 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.571035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01825-b885-4d47-a6eb-f9135b574f92 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.573071 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1126/2279] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:35.579796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4784-d615-470a-b8cb-820b2b0f3a81 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.579796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4784-d615-470a-b8cb-820b2b0f3a81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.580016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4784-d615-470a-b8cb-820b2b0f3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.599763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2dfa4784-d615-470a-b8cb-820b2b0f3a81 None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:35.600994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2dfa4784-d615-470a-b8cb-820b2b0f3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.613281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1154/2280] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:35.624471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01825-b885-4d47-a6eb-f9135b574f92 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:35.641842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01825-b885-4d47-a6eb-f9135b574f92 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:35.645682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:35.646342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.646626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.646932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.657571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:35.659085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:35.675594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1127/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:35.777858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5ac48-1c15-4fc9-bf36-11affd12df49 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.778219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5ac48-1c15-4fc9-bf36-11affd12df49 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.778573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5ac48-1c15-4fc9-bf36-11affd12df49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.797933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9aa5ac48-1c15-4fc9-bf36-11affd12df49 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:35.799282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9aa5ac48-1c15-4fc9-bf36-11affd12df49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:35.807549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1155/2282] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:35.820281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:35.832647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91c484-5e4f-4c94-bd4f-4f17e862690e service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:35.838721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:35.839469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:35.839822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:35.840457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:35.850981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:35.852867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:35.863715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1128/2283] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:36.458278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d55c-6a3f-498f-acfa-97431098d43f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:36.458759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d55c-6a3f-498f-acfa-97431098d43f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:36.458869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d55c-6a3f-498f-acfa-97431098d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:36.477073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9fb4d55c-6a3f-498f-acfa-97431098d43f None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:36.478318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb4d55c-6a3f-498f-acfa-97431098d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:36.485937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1156/2284] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:36.498616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:36.509561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24e5a3-8f1f-4136-85c5-fa0016c74658 service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:36.515176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:36.515824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:36.516106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:36.516380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:36.525190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:36.526985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:36.535781 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1129/2285] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:36.767624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac372-26ea-48e0-a47a-803c81161a53 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:36.767934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac372-26ea-48e0-a47a-803c81161a53 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:36.768233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac372-26ea-48e0-a47a-803c81161a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:36.787774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6a5ac372-26ea-48e0-a47a-803c81161a53 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:36.788998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a5ac372-26ea-48e0-a47a-803c81161a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:36.796770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1157/2286] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:36.811332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:36.822286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead21a1-bca3-42de-9420-5aa46686a405 service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:36.828866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:36.829544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:36.829824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:36.830095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:36.839837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:36.841452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:36.850653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1130/2287] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:37.180644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:37.180904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:37.181104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:37.200402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:37.201762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:37.210187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1158/2288] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:37.223712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:37.234560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ddedf-d2cd-4540-a8fe-97d74eafd9ad service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:37.239793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:37.240496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:37.240778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:37.241052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:37.254369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:37.256662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:37.265917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1131/2289] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:37.726770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:37.728397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:37.824633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf5f3-aa0f-4f1f-8cd7-34e218627d9d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:37.830545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:37.831855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:37.832287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:37.832739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] PATH_INFO: `/v3/users/eed6d87c79a549f88a4741e35b277669` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:37.834395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed6d87c79a549f88a4741e35b277669)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:37.836519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:37.922879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed6d87c79a549f88a4741e35b277669'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:37.924416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:37.942661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed6d87c79a549f88a4741e35b277669'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:37.952390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed6d87c79a549f88a4741e35b277669'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:37.964244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed6d87c79a549f88a4741e35b277669'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:37.965520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9d52c87-7a65-4aa0-8e2c-e30a14c15a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed6d87c79a549f88a4741e35b277669'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:37.985985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1159/2290] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:35:37 2022] DELETE /identity/v3/users/eed6d87c79a549f88a4741e35b277669 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:38.273520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:38.286148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe068c-be64-4d7f-a48e-eeaab47f02d4 service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:38.344230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:38.359184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:38.359586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:38.360225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:38.360636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] PATH_INFO: `/v3/projects/cac8e4f3ef2d4ede9cd8c4d6f4c223d0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:38.362022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac8e4f3ef2d4ede9cd8c4d6f4c223d0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:38.364258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:38.416475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac8e4f3ef2d4ede9cd8c4d6f4c223d0', 'request_id': 'req-74280305-29aa-49b8-8219-e6748e767041'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:38.426276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac8e4f3ef2d4ede9cd8c4d6f4c223d0', 'request_id': 'req-74280305-29aa-49b8-8219-e6748e767041'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:38.435912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac8e4f3ef2d4ede9cd8c4d6f4c223d0', 'request_id': 'req-74280305-29aa-49b8-8219-e6748e767041'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:38.450461 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] The token cache is being invalidate because project cac8e4f3ef2d4ede9cd8c4d6f4c223d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:35:38.450885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:38.451615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:38.455048 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1132/2291] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:35:38 2022] DELETE /identity/v3/projects/cac8e4f3ef2d4ede9cd8c4d6f4c223d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:38.510138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:38.510539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:38.511176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:38.531428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:38.533542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:38.603767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1160/2292] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:38.617050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:38.618511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:38.695081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280305-29aa-49b8-8219-e6748e767041 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:38.701334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:38.702090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:38.702614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:38.702976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:38.711337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:38.713042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373447fd-d09d-4b4f-93ed-2a926056c98e service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:38.722328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1133/2293] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:35:39.585712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:39.587445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:39.662068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d695-4e2c-4948-a315-a87b441cbfe6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:39.666762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:39.667705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:39.667984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:39.668260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] PATH_INFO: `/v3/users/a597e120452f466b810a498c089a1c01` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:39.669495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a597e120452f466b810a498c089a1c01)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:39.671536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:39.733102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a597e120452f466b810a498c089a1c01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:39.745334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a597e120452f466b810a498c089a1c01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:39.746015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a597e120452f466b810a498c089a1c01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:39.751632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:39.753832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a597e120452f466b810a498c089a1c01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:39.754705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a597e120452f466b810a498c089a1c01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:39.770058 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1161/2294] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:35:39 2022] DELETE /identity/v3/users/a597e120452f466b810a498c089a1c01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:39.779724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:39.782524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:39.783692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:39.803337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:39.804571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:39.869084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1134/2295] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:39.879027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:39.880492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:39.948212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c873-ec9c-41e5-a573-1fcce6006c37 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:39.952653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:39.953318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:39.953630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:39.953894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:39.963783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:39.965232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1d57-35e7-45b6-9bd2-54cbdd8967da service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:39.974643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1162/2296] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:35:40.170836 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.171782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:40.185938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7497f-f080-434e-8128-b6ae5459649d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.202339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.203759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.203916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.204311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] PATH_INFO: `/v3/projects/6701e51ea1a8442db5e4632ef20a9bd2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.206759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6701e51ea1a8442db5e4632ef20a9bd2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.209608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.212012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:40.295069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6701e51ea1a8442db5e4632ef20a9bd2', 'request_id': 'req-e85b2a38-fe2c-488f-a80e-08cb6c53e467'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:40.307871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6701e51ea1a8442db5e4632ef20a9bd2', 'request_id': 'req-e85b2a38-fe2c-488f-a80e-08cb6c53e467'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:40.322204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6701e51ea1a8442db5e4632ef20a9bd2', 'request_id': 'req-e85b2a38-fe2c-488f-a80e-08cb6c53e467'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:40.336853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] The token cache is being invalidate because project 6701e51ea1a8442db5e4632ef20a9bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:35:40.337146 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:40.337813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e85b2a38-fe2c-488f-a80e-08cb6c53e467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:40.339671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1135/2297] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:35:40 2022] DELETE /identity/v3/projects/6701e51ea1a8442db5e4632ef20a9bd2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:40.344715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.345423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.346078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.367168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:40.368439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:40.446461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1163/2298] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:40.454699 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.455020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.455303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.483295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:40.484570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:40.494399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1136/2299] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:40.498748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.509672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa899-b0ad-4011-8fb8-2f9516b9f7f7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.514386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.515099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.515386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.515662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.516403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:35:40.516715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.518346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.530453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1164/2300] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:35:40.535735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.545507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb582e-2f9c-4542-a049-8eae9eff988e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.550116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.550795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.551087 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.551361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.552112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.554009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.589586 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1137/2301] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:35:40 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:35:40.594115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.606090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f1331-c689-402c-b369-6067be999ed2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.669844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.670440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.670722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.671026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.671728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.673669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.700746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.702972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1165/2302] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:35:40 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:35:40.712784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eabba1-aca4-46b5-9da3-592d858a2b06 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.718463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.719051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.719339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.719620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.720367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.722110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.734105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1138/2303] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:35:40.738193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.766725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6aac-64d0-43e2-af73-a567d540a3f7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.771722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.772421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.775053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.775375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.776191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.777931 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47967f3-8795-4fab-acf1-13307ebead32 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.780619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:40.791399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1166/2304] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:35:40.795613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.807020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d719-e6a0-40e9-92ac-255eafc9a8e3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:40.811980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:40.813138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.813597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.814197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] PATH_INFO: `/v3/projects/055aa0182f244e56aa0550eb3b004523/users/29b408730baf4754b072cce09fd7db02/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.833798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=055aa0182f244e56aa0550eb3b004523, user_id=29b408730baf4754b072cce09fd7db02, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:40.836618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:40.852187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1139/2305] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:35:40 2022] PUT /identity/v3/projects/055aa0182f244e56aa0550eb3b004523/users/29b408730baf4754b072cce09fd7db02/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:35:40.863529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:40.863850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:40.864096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:40.892609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] MFA Rules not processed for user `29b408730baf4754b072cce09fd7db02`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:40.893900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:40.961562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1167/2306] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:40.972509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:40.974201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:41.045826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678d02-f00d-4fa0-a865-3a81b3713aaa admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:41.049527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:41.050230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:41.050520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:41.050799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:41.059786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:41.061276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:41.070083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1140/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:50.958494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=33 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:51.066384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:51.900518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:51.902039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:51.962022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32133e27-db34-4930-abfb-7b61b6e7b229 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:51.965615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:51.966275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:51.966558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:51.966865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:51.968665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:52.042555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:52.044053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04aae-3c15-4f4e-8353-5a419385705b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:52.055046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1168/2308] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:52.413202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:52.491992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722168-bb91-4727-8c7d-71ac5be4854d service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:52.497816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:52.498705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:52.499023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:52.499295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] PATH_INFO: `/v3/users/29b408730baf4754b072cce09fd7db02` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:52.500639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b408730baf4754b072cce09fd7db02)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:52.502583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:52.556728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b408730baf4754b072cce09fd7db02'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:52.568580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b408730baf4754b072cce09fd7db02'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:52.569258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b408730baf4754b072cce09fd7db02'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:52.577082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b408730baf4754b072cce09fd7db02'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:52.577709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b408730baf4754b072cce09fd7db02'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:52.590594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1141/2309] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:35:52 2022] DELETE /identity/v3/users/29b408730baf4754b072cce09fd7db02 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:35:52.595267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:52.595559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:52.595840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:52.614477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:52.615790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:52.676725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1169/2310] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:52.687425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:52.689251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:52.749944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b73f9-d196-4819-9cc1-f81f632ec03d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:52.754338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:52.754993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:52.755297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:52.755512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:52.765453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:52.766912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:52.776921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1142/2311] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:53.056953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:53.058442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:53.071609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7a23-fe58-4dac-9047-114824639ab3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:53.077739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:53.078224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:53.078571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:53.078934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] PATH_INFO: `/v3/projects/055aa0182f244e56aa0550eb3b004523` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:53.080213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055aa0182f244e56aa0550eb3b004523)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:53.082201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:53.127870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:53.139105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055aa0182f244e56aa0550eb3b004523', 'request_id': 'req-2dbc8987-1a76-440e-9272-54c7a6b89787'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:53.147554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055aa0182f244e56aa0550eb3b004523', 'request_id': 'req-2dbc8987-1a76-440e-9272-54c7a6b89787'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:53.153468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055aa0182f244e56aa0550eb3b004523', 'request_id': 'req-2dbc8987-1a76-440e-9272-54c7a6b89787'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:53.164725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] The token cache is being invalidate because project 055aa0182f244e56aa0550eb3b004523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:35:53.165013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:53.165653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2dbc8987-1a76-440e-9272-54c7a6b89787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:35:53.167238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1170/2312] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:35:53 2022] DELETE /identity/v3/projects/055aa0182f244e56aa0550eb3b004523 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:35:54.304537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:54.313917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc1aa-396b-471c-934c-fe7b6558a8de service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:54.334022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:54.367669 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:54.368315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:54.368595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:54.368873 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:54.370888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:54.444114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:54.445577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:54.457343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1143/2313] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:03.161643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:04.411041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:04.411617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:04.411617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:04.431718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:04.432928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:04.452240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=44 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:04.494487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1171/2314] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:04.507768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:04.509996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:04.597919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f221-eace-4e16-900e-5c6acd33442e service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:04.603252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:04.603909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:04.604353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:04.604638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:04.613510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:04.615200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:04.623207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1144/2315] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:36:09.116698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:09.119291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:09.141492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684d95-0729-44b1-bccf-6e08fb967674 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:09.148591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:09.149244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:09.149523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:09.149805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:09.151740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:09.217423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:09.219026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:09.228821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1172/2316] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:14.620084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=32 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:14.981236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:14.983205 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:15.003763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe04f-18f0-48e8-8d2f-faca68f69c7a service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:15.011547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:15.012194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:15.012476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:15.012779 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:15.014966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:15.076831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:15.078444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:15.087978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1145/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:19.224092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=53 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:24.989086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:24.991378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:25.003042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae0cd-356c-40f2-920f-055cb6850f72 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:25.008911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:25.009599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:25.010053 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:25.010339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:25.012695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:25.023491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:25.024953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fb3d5-ae40-4b2a-a488-c55497688542 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:25.034449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1173/2318] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:25.083423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=28 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:25.565707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:25.581489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad2d1-3f1d-4bb2-991d-b74eb7b5ee56 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:25.587493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:25.603008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:25.603311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:25.603599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:25.606334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:25.622084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:25.623811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:25.642621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1146/2319] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:28.988742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:28.989341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:28.989446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:29.009938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] MFA Rules not processed for user `c22bd4ec11c84c3c9f036664d992585d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:29.011990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:29.021724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1174/2320] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:29.336615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:29.346640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a769-cdfd-4ab1-a496-5eda2db7cf3b service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:29.350984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:29.351643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:29.351925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:29.352197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:29.354094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:29.364484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:29.365949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:29.373981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1147/2321] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:29.620987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:29.634986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9d585-9353-4cf9-b4f5-70ba365d2226 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:29.641792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:29.642452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:29.642797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:29.643158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:29.645397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:29.704268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:29.705947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:29.711240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:29.712960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:29.723202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1175/2322] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:29.788502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a6e8-e87e-44cc-8b25-025707865175 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:29.793636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:29.794307 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:29.794592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:29.794902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:29.796787 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:29.809584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:29.811269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:29.822192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1148/2323] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:33.643846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:33.661858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764625-47e9-40ce-927e-c604f6ab8bcb service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:33.676115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:33.676804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:33.677225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:33.677753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:33.680466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:33.697389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:33.699080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b57e19-5a66-4a4a-ab4c-fb323345c728 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:33.710990 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1176/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:39.817252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=44 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:40.923348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:40.938794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885576-da72-4e9d-868c-ccfe575f07fd service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:40.944408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:40.945063 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:40.945342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:40.945615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:40.947875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:40.960484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:40.962156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aef18d-18d0-407a-a29d-526b3a75220a service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:40.972552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1149/2325] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:43.705926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=43 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:50.968625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=6 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:54.348782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:54.349323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:54.349323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:54.367334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] MFA Rules not processed for user `59a76b6656854ed6a845a451dfcc0185`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:54.368522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:54.376859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1177/2326] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:04.362157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:16.099278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.099825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.099825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.118186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:16.119421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.127949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1150/2327] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:16.177640 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.190224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252a0e-b2a3-47f7-8315-eb6682cc7659 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.196299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.196989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.197247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.197555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.206190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.207831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.216210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1178/2328] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:37:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:37:16.601910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.603553 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.616824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03341ad-bfe6-48f9-a0bf-daca21a5305a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.621294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.621949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.622345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.622630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.624589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.700208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.701667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.711608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1151/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:19.857552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.874694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3bde8-9bb9-495a-bdd5-66ec1f92f0d6 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.880042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.880702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.880987 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.881270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.885712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:19.899340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.901136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.913122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1179/2330] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:23.216914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.218395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:23.230652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942fbb4-5c97-4c32-b640-6352878027ce service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.235376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.236267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.236546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.236818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] PATH_INFO: `/v3/users/6433d1961732423a8bbb1079f5eeab22` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.238050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6433d1961732423a8bbb1079f5eeab22)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.240026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.288072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6433d1961732423a8bbb1079f5eeab22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.299698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6433d1961732423a8bbb1079f5eeab22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.300404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6433d1961732423a8bbb1079f5eeab22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.308091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6433d1961732423a8bbb1079f5eeab22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.308980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6433d1961732423a8bbb1079f5eeab22'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.324816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1152/2331] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:23 2022] DELETE /identity/v3/users/6433d1961732423a8bbb1079f5eeab22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:23.501778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.513423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252725-8adc-4a59-ac27-a5cc8f6d2f9b service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.583949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.584858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.585158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.585409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] PATH_INFO: `/v3/projects/89a0b3188e5d433087b866c90be87b63` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.586917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a0b3188e5d433087b866c90be87b63)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.588949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.642160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a0b3188e5d433087b866c90be87b63', 'request_id': 'req-6b1c5eab-d19c-44d7-93f9-0227503c850e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.652930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a0b3188e5d433087b866c90be87b63', 'request_id': 'req-6b1c5eab-d19c-44d7-93f9-0227503c850e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.669533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a0b3188e5d433087b866c90be87b63', 'request_id': 'req-6b1c5eab-d19c-44d7-93f9-0227503c850e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.681663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] The token cache is being invalidate because project 89a0b3188e5d433087b866c90be87b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:23.681879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.682692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.684341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1180/2332] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:23 2022] DELETE /identity/v3/projects/89a0b3188e5d433087b866c90be87b63 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:23.688628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.690093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:23.710116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b085e9-6656-4109-a742-0250979bb718 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.785424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.786334 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.786592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.786896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] PATH_INFO: `/v3/users/fc8a3e45d0b647c7b4177832c87416bc` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.788115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8a3e45d0b647c7b4177832c87416bc)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.791958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.794457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:23.849068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8a3e45d0b647c7b4177832c87416bc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.861279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8a3e45d0b647c7b4177832c87416bc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.861978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8a3e45d0b647c7b4177832c87416bc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.868927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8a3e45d0b647c7b4177832c87416bc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.869653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8a3e45d0b647c7b4177832c87416bc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:23.883903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1153/2333] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:23 2022] DELETE /identity/v3/users/fc8a3e45d0b647c7b4177832c87416bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:24.061050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:24.062638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:24.081930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5eab-d19c-44d7-93f9-0227503c850e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:24.146385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.147304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.147586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.147888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] PATH_INFO: `/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.149094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47a84378ff841f88a8ba8b78c2ac2dc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.151080 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.157285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:24.200779 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47a84378ff841f88a8ba8b78c2ac2dc', 'request_id': 'req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:24.208815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47a84378ff841f88a8ba8b78c2ac2dc', 'request_id': 'req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:24.216505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47a84378ff841f88a8ba8b78c2ac2dc', 'request_id': 'req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:24.233563 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] The token cache is being invalidate because project b47a84378ff841f88a8ba8b78c2ac2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:24.233897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:24.234985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3c9d9ac8-d338-4b55-bf41-bc4f0878404a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:24.237360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1181/2334] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:24 2022] DELETE /identity/v3/projects/b47a84378ff841f88a8ba8b78c2ac2dc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:28.747625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:28.749647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.831532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e00a-b197-4b35-b663-eb0fc0642ab3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:28.897180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:28.897867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.898152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.898428 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.900441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.921479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:28.972427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:28.974068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:28.983468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1154/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:30.947121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795037-ef5f-4ef8-a267-6d03ecc8056f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:30.947635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795037-ef5f-4ef8-a267-6d03ecc8056f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:30.947635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795037-ef5f-4ef8-a267-6d03ecc8056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:30.966901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-03795037-ef5f-4ef8-a267-6d03ecc8056f None None] MFA Rules not processed for user `368d131be665431ab226f20011b38c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:30.968131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-03795037-ef5f-4ef8-a267-6d03ecc8056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:30.977310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1182/2336] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:31.299305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:31.300837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.363369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344e90-6f75-44b8-8ff9-0a9799ff6281 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:31.367854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:31.368517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:31.368788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:31.369068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:31.371222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.384330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:31.385927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:31.394647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1155/2337] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:40.961296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:41.390821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=47 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:46.358555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bfcfd-1263-412b-845f-42ccb6095380 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:46.359093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bfcfd-1263-412b-845f-42ccb6095380 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:46.359209 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bfcfd-1263-412b-845f-42ccb6095380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:46.377013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4a1bfcfd-1263-412b-845f-42ccb6095380 None None] MFA Rules not processed for user `bb1c4b49c3cb4fd8b45e4233f431b741`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:46.378217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a1bfcfd-1263-412b-845f-42ccb6095380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:46.434592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1183/2338] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:56.427519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=25 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:38.282103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.283626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:38.294665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad145a9-8692-4046-a362-e392e337cc29 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.298751 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.299465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.299737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.300016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.301803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:38.364893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.366376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.376580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1156/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:40.952072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:40.952601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:40.952601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:40.970128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] MFA Rules not processed for user `c22bd4ec11c84c3c9f036664d992585d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:40.971394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:41.047588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1184/2340] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:42.048324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.050383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.126222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.129995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.229377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55404c-c0c4-48e8-99b1-e121b766d2ea None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.235275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.236393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.236690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.236964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] PATH_INFO: `/v3/users/59a76b6656854ed6a845a451dfcc0185` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.238170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a76b6656854ed6a845a451dfcc0185)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.238552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47322568-4868-43bf-b1d0-2ed97da19f05 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.240250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.244060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.245076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.245573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.245890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.249812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.263577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.265276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.277162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1157/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:42.306139 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a76b6656854ed6a845a451dfcc0185'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.320801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a76b6656854ed6a845a451dfcc0185'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.321499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a76b6656854ed6a845a451dfcc0185'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.329285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a76b6656854ed6a845a451dfcc0185'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.329926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e48cf6d1-8667-4a4f-90f9-39636de3ded7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a76b6656854ed6a845a451dfcc0185'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.343456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1185/2342] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:42 2022] DELETE /identity/v3/users/59a76b6656854ed6a845a451dfcc0185 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:42.518768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.530376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771b2f-a39a-46c1-a02c-006dbbd81590 service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.568839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:42.604289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.605139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.605412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.605701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] PATH_INFO: `/v3/projects/e0a9744536c246589d29fb6da893353c` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.606999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a9744536c246589d29fb6da893353c)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.608962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.660227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a9744536c246589d29fb6da893353c', 'request_id': 'req-748c1935-999b-4cfb-8a0e-2d09b3e5976e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.670595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a9744536c246589d29fb6da893353c', 'request_id': 'req-748c1935-999b-4cfb-8a0e-2d09b3e5976e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.677548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a9744536c246589d29fb6da893353c', 'request_id': 'req-748c1935-999b-4cfb-8a0e-2d09b3e5976e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.688134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] The token cache is being invalidate because project e0a9744536c246589d29fb6da893353c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:42.688418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.689073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-748c1935-999b-4cfb-8a0e-2d09b3e5976e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:42.690624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1158/2343] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:42 2022] DELETE /identity/v3/projects/e0a9744536c246589d29fb6da893353c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:42.696155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.696496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.696815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.716680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:42.755448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:42.756669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.827754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1186/2344] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:42.836602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.836986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.837370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.856665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:42.857822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.865881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1159/2345] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:42.870995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.881354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cbf83-8679-4c3c-9164-6ad7ab835350 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.887579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.888634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.888989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.889269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.890019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:42.890330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.891996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.905546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1187/2346] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:42.910118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.920410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a016b7-3a17-4825-b19e-c622c1203fd6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.926559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.927280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.927557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.927825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.928535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.930600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.960805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1160/2347] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:42.965084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.977396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489d9f7-592d-41cf-900c-dcff04f90cce admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.057573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.058809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.059282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.059754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.063186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.065355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.095330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1188/2348] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:42 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:43.101311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.113042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3075c-2c1e-4c57-bb87-d398340b05b8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.118589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.119456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.119803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.120493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.121014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.122678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.133559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1161/2349] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:43.137535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.147871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc2587-fb33-418e-91d9-6b795965d208 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.152584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.153252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.153536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.153810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.154551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.156206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18930d5-b4e0-41a0-a130-c34de576a3da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.166161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1189/2350] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:43.170332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.180340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b845b-b961-4523-842f-a7d7e19757a5 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.185061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.185957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.186235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.186511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] PATH_INFO: `/v3/projects/0d1f38e0983b48018756ec5a9edc4a4e/users/652ba7b061304d0e9546bcd09a689b2c/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.203655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1f38e0983b48018756ec5a9edc4a4e, user_id=652ba7b061304d0e9546bcd09a689b2c, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.206320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.223666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1162/2351] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:43 2022] PUT /identity/v3/projects/0d1f38e0983b48018756ec5a9edc4a4e/users/652ba7b061304d0e9546bcd09a689b2c/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:43.234246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.234541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.234847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.262874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] MFA Rules not processed for user `652ba7b061304d0e9546bcd09a689b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:43.264248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:43.309254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:43.338945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1190/2352] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:43.343585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.411075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd1be-8bf7-4cbb-9fd0-49fd79b9a6ca admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.415967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.416644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.416926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.417202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.417918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.419880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.424777 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:43.454156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1163/2353] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:43 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:43.458022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.469545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b225a-64ad-4719-a870-4a868610670a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.530022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.530704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.531006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.531279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.531979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.533930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.557798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1191/2354] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:43 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:43.561814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.572840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238ac4-5b99-413c-b13c-7c8867c1617f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.577729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.578408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.578731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.579045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.579784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.581505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.592952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1164/2355] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:43.597906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.608610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de77d-4f93-49ae-9433-e79c021f6645 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.614024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.614986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.615320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.615550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] PATH_INFO: `/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93/users/a9fe4b2976644579b02bdac3248e2081/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.634054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcafdb6bfd44dfda65a21efe7b6ce93, user_id=a9fe4b2976644579b02bdac3248e2081, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.636805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.651628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1192/2356] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:43 2022] PUT /identity/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93/users/a9fe4b2976644579b02bdac3248e2081/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:43.655888 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.667463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f373-c7de-4293-9619-bf4414ba9bd6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.730747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.731607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.731990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.732365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.733221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.734992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ba6-c7be-457a-9218-2678624268e3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.746413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1165/2357] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:43.750583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.762666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3d05-a07d-44f0-b606-f2a29aeb874b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.767692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.768821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.769167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.769697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] PATH_INFO: `/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93/users/a9fe4b2976644579b02bdac3248e2081/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.772453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcafdb6bfd44dfda65a21efe7b6ce93, user_id=a9fe4b2976644579b02bdac3248e2081, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.777430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.788450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1193/2358] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:43 2022] PUT /identity/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93/users/a9fe4b2976644579b02bdac3248e2081/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:43.799627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.799924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.800204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.828815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] MFA Rules not processed for user `a9fe4b2976644579b02bdac3248e2081`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:43.830047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:43.902483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1166/2359] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:43.914359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.916491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:43.988907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7879e-b72f-4871-9ed2-b4ad3a1d5f5e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.992753 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.993411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.993694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.993975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.003443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:44.004907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083919a-6fb0-4c4f-b56a-d641151e4faf service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:44.015401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1194/2360] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:44.432088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:44.499656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:44.507184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0b956-b13d-4469-87be-bb9e6fd5eb2e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:44.512755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:44.513681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.513962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.514238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] PATH_INFO: `/v3/users/652ba7b061304d0e9546bcd09a689b2c` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.515889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652ba7b061304d0e9546bcd09a689b2c)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:44.517864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:44.588694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652ba7b061304d0e9546bcd09a689b2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.602318 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652ba7b061304d0e9546bcd09a689b2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.603079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652ba7b061304d0e9546bcd09a689b2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.612488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652ba7b061304d0e9546bcd09a689b2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.613093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652ba7b061304d0e9546bcd09a689b2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.639507 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1167/2361] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:44 2022] DELETE /identity/v3/users/652ba7b061304d0e9546bcd09a689b2c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:44.644022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c063-8431-4591-95ce-4652f3185aef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.645213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c063-8431-4591-95ce-4652f3185aef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.645796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c063-8431-4591-95ce-4652f3185aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.671901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d936c063-8431-4591-95ce-4652f3185aef None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:44.673293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d936c063-8431-4591-95ce-4652f3185aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:44.707059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:44.743401 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1195/2362] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:44.753478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:44.755000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:44.833927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970625-87de-4ce9-ab0c-d8796dd6b868 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:44.839513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:44.840435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.841007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.841730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.856231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:44.857368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:44.867872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1168/2363] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:45.260832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c063-8431-4591-95ce-4652f3185aef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.262452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d936c063-8431-4591-95ce-4652f3185aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:45.277195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c063-8431-4591-95ce-4652f3185aef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.281916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.282926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.283876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.284741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] PATH_INFO: `/v3/projects/0d1f38e0983b48018756ec5a9edc4a4e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.285916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1f38e0983b48018756ec5a9edc4a4e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.288086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.336580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1f38e0983b48018756ec5a9edc4a4e', 'request_id': 'req-cc300092-330c-4fa5-adae-2c7f925bbecb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.344962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1f38e0983b48018756ec5a9edc4a4e', 'request_id': 'req-cc300092-330c-4fa5-adae-2c7f925bbecb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.351061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1f38e0983b48018756ec5a9edc4a4e', 'request_id': 'req-cc300092-330c-4fa5-adae-2c7f925bbecb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.362362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] The token cache is being invalidate because project 0d1f38e0983b48018756ec5a9edc4a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:45.362654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.363414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.365627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1196/2364] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:45 2022] DELETE /identity/v3/projects/0d1f38e0983b48018756ec5a9edc4a4e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:45.369723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.379425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b22-da5d-471e-9605-300edd780647 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.442736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.443679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.443958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.444234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] PATH_INFO: `/v3/users/a9fe4b2976644579b02bdac3248e2081` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.445944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fe4b2976644579b02bdac3248e2081)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.447919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.470504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:45.501140 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fe4b2976644579b02bdac3248e2081'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.516174 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fe4b2976644579b02bdac3248e2081'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.516968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fe4b2976644579b02bdac3248e2081'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.527177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fe4b2976644579b02bdac3248e2081'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.528089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-87094c85-ec8c-48d3-a7f9-7ee64d1971d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fe4b2976644579b02bdac3248e2081'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.543736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1169/2365] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:45 2022] DELETE /identity/v3/users/a9fe4b2976644579b02bdac3248e2081 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:45.827862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.829406 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:45.845625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300092-330c-4fa5-adae-2c7f925bbecb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.910076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.911014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.911320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.911596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] PATH_INFO: `/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.912915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcafdb6bfd44dfda65a21efe7b6ce93)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.914974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.965626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcafdb6bfd44dfda65a21efe7b6ce93', 'request_id': 'req-b983dd7b-6279-4173-b43e-8c8ddc81a906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.974397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcafdb6bfd44dfda65a21efe7b6ce93', 'request_id': 'req-b983dd7b-6279-4173-b43e-8c8ddc81a906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.978799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:45.981242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcafdb6bfd44dfda65a21efe7b6ce93', 'request_id': 'req-b983dd7b-6279-4173-b43e-8c8ddc81a906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.994425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] The token cache is being invalidate because project 9dcafdb6bfd44dfda65a21efe7b6ce93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:45.994722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.995610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b983dd7b-6279-4173-b43e-8c8ddc81a906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:45.997294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1197/2366] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:45 2022] DELETE /identity/v3/projects/9dcafdb6bfd44dfda65a21efe7b6ce93 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.002662 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.002894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.003172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.021697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:46.023003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.085782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1170/2367] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:46.094982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.095265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.095542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.113995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:46.115226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.126654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1198/2368] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:46.131540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.146220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b9c15-7c3f-4455-b24e-7477d699ece4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.152695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.153365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.153644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.153916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.154683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:46.155020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.156639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.169297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1171/2369] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:46.173334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.183386 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e270fe-7ad2-40b4-8e9f-478e8f0f54ba None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.189896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.191747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.192186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.192471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.193228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.195644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.228167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1199/2370] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:46.233223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.244239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbfa8-a351-45ac-bf21-e32d127991ee admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.312022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.312733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.313064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.313438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.314462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.317509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.337954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1172/2371] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:46.342148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.353115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2986b2-8ef2-4a12-bf87-408d29b38914 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.359086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.359752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.360027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.360299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.361068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.362680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.373874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1200/2372] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.377840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.388451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2891b-77c6-4520-90ee-1990d47fcd7a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.393747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.394412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.394694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.395004 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.395736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.397337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c032657-a117-4263-af12-00544a5cb5c4 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.407920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1173/2373] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.412440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.422434 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb17e58-e4f4-4786-80ab-2da32b8c6553 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.427512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.428397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.428678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.428949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] PATH_INFO: `/v3/projects/08b3448ec387471a8b7a795486b87ac0/users/4cc262effbef42fbb305ba8c03155706/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.443715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b3448ec387471a8b7a795486b87ac0, user_id=4cc262effbef42fbb305ba8c03155706, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.446915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.461412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1201/2374] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:46 2022] PUT /identity/v3/projects/08b3448ec387471a8b7a795486b87ac0/users/4cc262effbef42fbb305ba8c03155706/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.471942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.472424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.472522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.479877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:46.503382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] MFA Rules not processed for user `4cc262effbef42fbb305ba8c03155706`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:46.504627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.576253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1174/2375] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:46.580637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.649445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe698-4cbe-475e-9070-d244166ba32e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.654043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.654710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.655014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.655294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.655975 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.657914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.686616 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1202/2376] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:46.687915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.700867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c58522-c5eb-4b59-8d9d-4359e6584586 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.758052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.758720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.759026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.759300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.759978 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.761909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.783346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1175/2377] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:46.787458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.798395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d169eb-64aa-4d4e-9958-b00cbce99a4f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.803842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.804776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.805062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.805339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.806078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.807745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.818666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1203/2378] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.823427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.833805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a70cd-54c5-4219-8de1-efff3b674385 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.839480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.840405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.840689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.840966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] PATH_INFO: `/v3/projects/70b08e73f0224d319520c04520c123e2/users/adaed13d3c644bbea0194b49ac34a8aa/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.856374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b08e73f0224d319520c04520c123e2, user_id=adaed13d3c644bbea0194b49ac34a8aa, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.859108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.874265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1176/2379] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:46 2022] PUT /identity/v3/projects/70b08e73f0224d319520c04520c123e2/users/adaed13d3c644bbea0194b49ac34a8aa/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.879072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.894163 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797e7-3117-4426-b2c6-4474f905d9c6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.953996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.954670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.954986 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.955268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.956008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.957617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae89d2-ef69-498e-81dc-5c5919d6e683 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.958923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:46.971561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1204/2380] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.975695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.986415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e83d2-70d5-48ee-b78a-a099ee3ef82b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.991313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.992238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.992515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.992786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] PATH_INFO: `/v3/projects/70b08e73f0224d319520c04520c123e2/users/adaed13d3c644bbea0194b49ac34a8aa/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.994870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b08e73f0224d319520c04520c123e2, user_id=adaed13d3c644bbea0194b49ac34a8aa, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.997526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.008046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1177/2381] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:46 2022] PUT /identity/v3/projects/70b08e73f0224d319520c04520c123e2/users/adaed13d3c644bbea0194b49ac34a8aa/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:47.019270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.019580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.019846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.046510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] MFA Rules not processed for user `adaed13d3c644bbea0194b49ac34a8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:47.047869 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.120653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1205/2382] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:47.132583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.134485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.188636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:47.196127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d91397-e9a9-49c4-85aa-ac6bef7a3e6d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.200645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.201300 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.201583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.201919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.211867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.213328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.225447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1178/2383] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:47.303378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.313161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba11c97-5b18-4957-b610-048b2c5d5629 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.316908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.317552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.317838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.318109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.378543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.382065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351e069-1d56-4d87-8e64-82cc0ed9b742 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.391514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1206/2384] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:54.478039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:54.540537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940132-e527-4e8e-a75f-7380a7501380 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:54.545263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:54.546152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:54.546434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:54.546714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] PATH_INFO: `/v3/users/4cc262effbef42fbb305ba8c03155706` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:54.547949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc262effbef42fbb305ba8c03155706)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:54.549936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:54.601808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc262effbef42fbb305ba8c03155706'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:54.613782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc262effbef42fbb305ba8c03155706'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:54.614612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc262effbef42fbb305ba8c03155706'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:54.621780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc262effbef42fbb305ba8c03155706'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:54.622480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc262effbef42fbb305ba8c03155706'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:54.636030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1179/2385] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:54 2022] DELETE /identity/v3/users/4cc262effbef42fbb305ba8c03155706 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:54.640645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:54.641151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:54.641255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:54.658731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:54.659969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:54.726886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1207/2386] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:54.737488 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:54.739145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:54.808088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe58f-5dd5-46a2-a007-c703283daee6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:54.811989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:54.812658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:54.812940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:54.813346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:54.824583 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:54.826343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:54.837016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1180/2387] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:55.292568 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:55.293714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:55.306558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa616-7747-4fa1-92cf-5c575d043e92 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:55.311911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:55.312919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:55.313297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:55.313732 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] PATH_INFO: `/v3/projects/08b3448ec387471a8b7a795486b87ac0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:55.315116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b3448ec387471a8b7a795486b87ac0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:55.317190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:55.336961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:55.374002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b3448ec387471a8b7a795486b87ac0', 'request_id': 'req-6050f317-8fa5-43bc-825f-3fc6f6bf2114'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.381868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b3448ec387471a8b7a795486b87ac0', 'request_id': 'req-6050f317-8fa5-43bc-825f-3fc6f6bf2114'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.387922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b3448ec387471a8b7a795486b87ac0', 'request_id': 'req-6050f317-8fa5-43bc-825f-3fc6f6bf2114'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.399042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] The token cache is being invalidate because project 08b3448ec387471a8b7a795486b87ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:55.399326 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.400005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.401566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1208/2388] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:55 2022] DELETE /identity/v3/projects/08b3448ec387471a8b7a795486b87ac0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:55.405611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:55.415771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bc98-ce7b-4a65-aa5f-9a08e5d0e1ff service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:55.424535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:55.479412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:55.480955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:55.481238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:55.481542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] PATH_INFO: `/v3/users/adaed13d3c644bbea0194b49ac34a8aa` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:55.482776 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaed13d3c644bbea0194b49ac34a8aa)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:55.484757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:55.533383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaed13d3c644bbea0194b49ac34a8aa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.545693 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaed13d3c644bbea0194b49ac34a8aa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.546438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaed13d3c644bbea0194b49ac34a8aa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.555696 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaed13d3c644bbea0194b49ac34a8aa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.556400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaed13d3c644bbea0194b49ac34a8aa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:55.570566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1181/2389] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:55 2022] DELETE /identity/v3/users/adaed13d3c644bbea0194b49ac34a8aa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:55.672712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:55.674079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:55.793479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f317-8fa5-43bc-825f-3fc6f6bf2114 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:55.872876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:55.873692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:55.873988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:55.874331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:55.876231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:55.882116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:55.884437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:55.893611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:55.895307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d979b77-0d5d-49c9-b1fb-fbeb612a4d08 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:55.917734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1209/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:55.965640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c7712-0023-4a0a-92c5-6c34830f2d7d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:55.970794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:55.971685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:55.971966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:55.972249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] PATH_INFO: `/v3/projects/70b08e73f0224d319520c04520c123e2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:55.973968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b08e73f0224d319520c04520c123e2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:55.975933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.020412 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:56.042290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b08e73f0224d319520c04520c123e2', 'request_id': 'req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:56.052851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b08e73f0224d319520c04520c123e2', 'request_id': 'req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:56.059845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b08e73f0224d319520c04520c123e2', 'request_id': 'req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:56.073523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] The token cache is being invalidate because project 70b08e73f0224d319520c04520c123e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:56.074211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:56.074474 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-ccc14fa6-acc6-4ed3-ad1d-de850af6622d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:56.079851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1182/2391] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:55 2022] DELETE /identity/v3/projects/70b08e73f0224d319520c04520c123e2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:56.081330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.081626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.081911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.104130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:56.105457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:56.115686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:56.174831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1210/2392] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:56.177178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.177465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.177737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.196285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:56.197607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:56.205872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1183/2393] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:56.209971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.219881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f164bb-01e7-4813-97c3-17495677e23d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.225510 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.226300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.226589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.226892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.227730 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:56.228066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.229739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.241818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1211/2394] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:56.246226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.255486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33c379-cf46-4cfa-9c3b-3fa344417603 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.260325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.261003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.261284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.261560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.262259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.264224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.291405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1184/2395] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:56.295576 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.306073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77fda-1a6b-4e6c-b3a8-61e14d58db1c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.375801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.376525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.376777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.377046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.377750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.379778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.406903 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1212/2396] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:56.409656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.420885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75b10-1c81-46e1-bf1f-d2477d9d51b1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.425441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.426126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.426515 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.426802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.427543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.429150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.443437 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1185/2397] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:56.448550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.460649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fb5c-9e2f-4929-83fa-5183ca022561 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.466247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.467050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.467729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.467729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.468349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.469970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6c91-101c-4feb-bde1-044cc16830b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.483612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1213/2398] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:56.486352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.495936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a260-b560-456d-a371-65dfc377b3db admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.500837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.501739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.502017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.502285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] PATH_INFO: `/v3/projects/fb788f925bf347628a0f43ce5331a8ed/users/d220247ab8544f4b88c5a1c4d25f0958/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.519326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb788f925bf347628a0f43ce5331a8ed, user_id=d220247ab8544f4b88c5a1c4d25f0958, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.522185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.541186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1186/2399] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:56 2022] PUT /identity/v3/projects/fb788f925bf347628a0f43ce5331a8ed/users/d220247ab8544f4b88c5a1c4d25f0958/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:56.551852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.552348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.552808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.583380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] MFA Rules not processed for user `d220247ab8544f4b88c5a1c4d25f0958`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:56.584750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:56.661294 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1214/2400] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:56.668202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.748274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c781f2-ec65-45f3-b6f6-4657b5b223fe admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.754555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.755524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.755897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.756078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.756763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.759013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.805198 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1187/2401] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:56.809634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.822238 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c679c29-f4ab-41c6-96be-3987d7985af6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.830727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:56.887731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.888474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.888761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.889037 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.889750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.891743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.919678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.920086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1215/2402] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:56 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:56.930940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f320-8b44-4540-ac3e-4b934d8d5321 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.939233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.940526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.940847 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.941381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.942258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.943977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:56.956075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1188/2403] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:56.960479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:56.970981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a5c49-7607-4705-907f-eaca3c141000 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:56.975884 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:56.976893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:56.977256 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:56.977691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] PATH_INFO: `/v3/projects/9d3289d5932142218b71529818e2dcca/users/154b6b041e20423cbabf6dbb1302c4f5/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:56.993589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3289d5932142218b71529818e2dcca, user_id=154b6b041e20423cbabf6dbb1302c4f5, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:56.996443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.016010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1216/2404] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:56 2022] PUT /identity/v3/projects/9d3289d5932142218b71529818e2dcca/users/154b6b041e20423cbabf6dbb1302c4f5/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:57.017865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.029727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fca35-fdc7-452a-8685-52b820a7b838 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.062168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:57.096144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.096934 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.097361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.097704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.098532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.100244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcf130-3c9c-4469-904c-6df1165f6dc8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.110468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1189/2405] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:57.114914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.125276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f6c35-f5f9-4201-9e27-b6e918f0a477 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.130859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.131774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.132059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.132354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] PATH_INFO: `/v3/projects/9d3289d5932142218b71529818e2dcca/users/154b6b041e20423cbabf6dbb1302c4f5/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.135103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3289d5932142218b71529818e2dcca, user_id=154b6b041e20423cbabf6dbb1302c4f5, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.137849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.150651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1217/2406] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:57 2022] PUT /identity/v3/projects/9d3289d5932142218b71529818e2dcca/users/154b6b041e20423cbabf6dbb1302c4f5/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:57.161764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.162019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.162316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.196661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] MFA Rules not processed for user `154b6b041e20423cbabf6dbb1302c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:57.197973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.270241 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1190/2407] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:57.281820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.283813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.345200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ffa-5fcd-48e9-9188-2de6cf8c475a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.349723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.350378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.350678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.350973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.361123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.362596 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.372398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1218/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:57.459240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.469413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d738c-6e74-4893-8531-398066c1f3bb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.473326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.473974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.474254 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.474525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.533925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.535404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b24f8d-d0bb-46e0-9399-4723afec3fae service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.544681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1191/2409] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:02.304717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.369332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164364-7b9c-496f-b15c-1335bc94af1a service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.374208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.375116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.375399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.375662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] PATH_INFO: `/v3/users/d220247ab8544f4b88c5a1c4d25f0958` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.376912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d220247ab8544f4b88c5a1c4d25f0958)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.378852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.384525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:02.433280 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd220247ab8544f4b88c5a1c4d25f0958'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:02.445775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd220247ab8544f4b88c5a1c4d25f0958'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:02.446444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd220247ab8544f4b88c5a1c4d25f0958'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:02.454006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd220247ab8544f4b88c5a1c4d25f0958'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:02.454718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd220247ab8544f4b88c5a1c4d25f0958'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:02.469224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1219/2410] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:02 2022] DELETE /identity/v3/users/d220247ab8544f4b88c5a1c4d25f0958 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:02.473816 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.474306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.474410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.491941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:02.493177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.540235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:02.556511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1192/2411] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:02.566625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.568330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.654681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb3f63-c7c5-48aa-80d4-4528eb1e7cfc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.659400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.660062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.660348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.660628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.670433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.672066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.682682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1220/2412] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:02.980531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.982183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.997590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3badbd7-9175-4525-a679-74dce9dc175a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.002735 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.003786 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.003959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.004233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] PATH_INFO: `/v3/projects/fb788f925bf347628a0f43ce5331a8ed` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.005401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb788f925bf347628a0f43ce5331a8ed)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.007371 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.055552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb788f925bf347628a0f43ce5331a8ed', 'request_id': 'req-5c7af600-c0df-4121-9802-dfec0326b71a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.063709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb788f925bf347628a0f43ce5331a8ed', 'request_id': 'req-5c7af600-c0df-4121-9802-dfec0326b71a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.070762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb788f925bf347628a0f43ce5331a8ed', 'request_id': 'req-5c7af600-c0df-4121-9802-dfec0326b71a'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.081690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] The token cache is being invalidate because project fb788f925bf347628a0f43ce5331a8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:03.081976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.082623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.084213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1193/2413] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:02 2022] DELETE /identity/v3/projects/fb788f925bf347628a0f43ce5331a8ed => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:03.088418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.098262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce05a10-dfde-44ee-ad79-90782b1bad8a service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.157784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.158715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.159020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.159934 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] PATH_INFO: `/v3/users/154b6b041e20423cbabf6dbb1302c4f5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.161164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=154b6b041e20423cbabf6dbb1302c4f5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.163183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.173543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:03.211742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154b6b041e20423cbabf6dbb1302c4f5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.224560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154b6b041e20423cbabf6dbb1302c4f5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.225320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154b6b041e20423cbabf6dbb1302c4f5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.232330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154b6b041e20423cbabf6dbb1302c4f5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.232925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05d783a0-fb41-4810-bd27-6ab18af433dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154b6b041e20423cbabf6dbb1302c4f5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.246549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1221/2414] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:03 2022] DELETE /identity/v3/users/154b6b041e20423cbabf6dbb1302c4f5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:03.549714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.551221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:03.564724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af600-c0df-4121-9802-dfec0326b71a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.627856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.628917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.629179 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.629470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] PATH_INFO: `/v3/projects/9d3289d5932142218b71529818e2dcca` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.631249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3289d5932142218b71529818e2dcca)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.633537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.684902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3289d5932142218b71529818e2dcca', 'request_id': 'req-9ac588e4-8354-4f88-ac96-19e63befe646'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.693607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3289d5932142218b71529818e2dcca', 'request_id': 'req-9ac588e4-8354-4f88-ac96-19e63befe646'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.700277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3289d5932142218b71529818e2dcca', 'request_id': 'req-9ac588e4-8354-4f88-ac96-19e63befe646'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.710651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] The token cache is being invalidate because project 9d3289d5932142218b71529818e2dcca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:03.710974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.711597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ac588e4-8354-4f88-ac96-19e63befe646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:03.713169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1194/2415] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:03 2022] DELETE /identity/v3/projects/9d3289d5932142218b71529818e2dcca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:03.718555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.719039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.719148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.737154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:03.738377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:03.797084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1222/2416] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:03.805295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.805585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.805867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.813744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:03.826730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:03.828994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:03.839478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1195/2417] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:03.843985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.853900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b834d-aee7-47b3-a517-c87da28e1bd1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.858902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.859559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.859844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.860114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.860819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:03.861123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.862715 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.874716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1223/2418] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:03.879191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.888739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf3a3-287d-4350-8037-34f42cc5ecb4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.894819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.895489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.895773 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.896050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.896744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.898674 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.931141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1196/2419] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:03 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:03.932469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.946365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381467f9-b209-4c39-80ca-2ee049e7699b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.005734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.006330 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.006584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.006929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.007594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.009525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.031608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1224/2420] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:03 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:04.035799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.046595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfcd-b172-4d85-9954-bf999ea19b52 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.051591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.052342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.052668 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.052952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.053694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.055335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.065933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1197/2421] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:04.070199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.076881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:04.081178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0872a3-8330-4a29-91c0-b81a83b7effc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.087815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.088541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.088850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.089132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.090410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.092531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306d092-995e-43c7-a6a9-6ed03c3374d3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.103199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1225/2422] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:04.107622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.118382 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8326-4a56-4493-b434-239a372648f1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.124167 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.125073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.125354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.125631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] PATH_INFO: `/v3/projects/7c77645f7b6b4c5c8c97149958f87c56/users/4c079c9a88dd46f6a55d93821f8614ed/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.143022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c77645f7b6b4c5c8c97149958f87c56, user_id=4c079c9a88dd46f6a55d93821f8614ed, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.147346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.168339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1198/2423] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:04 2022] PUT /identity/v3/projects/7c77645f7b6b4c5c8c97149958f87c56/users/4c079c9a88dd46f6a55d93821f8614ed/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:04.179107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.179398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.179673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.212645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] MFA Rules not processed for user `4c079c9a88dd46f6a55d93821f8614ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:04.214216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:04.288844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1226/2424] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:04.298907 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.382363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fac08-a2f3-4082-86f6-60fb6c90809b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.389678 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.390346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.390630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.390964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.391656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.393609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.423016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1199/2425] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:04 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:04.427324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.438228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9253d-9537-42c0-b578-92e5e829ad8f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.501103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.501798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.502110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.502367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.503144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.505119 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.527503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1227/2426] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:04 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:04.531829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.542265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6cdd-412a-45c9-b485-e7a40b872294 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.546818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.547516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.547801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.548077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.548813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.550427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.561088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1200/2427] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:04.566472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.577176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbe90f-f529-4b5a-a6c6-b2083194652c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.582953 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.583842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.584121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.584395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] PATH_INFO: `/v3/projects/4ee271e6b0014bffb27d0e5c8da65983/users/2327ec8487f7430da73e75e898c0285f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.600591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee271e6b0014bffb27d0e5c8da65983, user_id=2327ec8487f7430da73e75e898c0285f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.603313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.618431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1228/2428] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:04 2022] PUT /identity/v3/projects/4ee271e6b0014bffb27d0e5c8da65983/users/2327ec8487f7430da73e75e898c0285f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:04.622469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.633849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d281-60a9-419d-9518-6a202e3be447 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.698571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.699284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.699860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.700152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.700887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.706616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca897e-f55a-4a41-a363-22270803d4c2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.717347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1201/2429] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:04.723074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.737777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178c3b-e295-4ea4-a2e1-6107772269da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.752314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.753241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.753524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.753809 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] PATH_INFO: `/v3/projects/4ee271e6b0014bffb27d0e5c8da65983/users/2327ec8487f7430da73e75e898c0285f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.755993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee271e6b0014bffb27d0e5c8da65983, user_id=2327ec8487f7430da73e75e898c0285f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.758678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.770175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1229/2430] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:04 2022] PUT /identity/v3/projects/4ee271e6b0014bffb27d0e5c8da65983/users/2327ec8487f7430da73e75e898c0285f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:04.781785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.782094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.782374 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.803868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:04.815537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] MFA Rules not processed for user `2327ec8487f7430da73e75e898c0285f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:04.818220 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:04.891946 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1202/2431] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:04.903114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.904966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:04.945546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:04.964615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d23e-3f24-41cf-96cc-dccd496fe221 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.968747 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.969381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.969666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.969942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.979317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.980845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24b6a2-88e2-4959-b6fe-a91172af27be service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.991415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1230/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:05.590559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:05.656520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3754a-ecef-4876-a364-96500d2d6ae6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:05.661113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:05.661958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:05.662237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:05.662495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] PATH_INFO: `/v3/users/4c079c9a88dd46f6a55d93821f8614ed` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:05.663718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c079c9a88dd46f6a55d93821f8614ed)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:05.665676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:05.715980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c079c9a88dd46f6a55d93821f8614ed'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:05.728837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c079c9a88dd46f6a55d93821f8614ed'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:05.729634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c079c9a88dd46f6a55d93821f8614ed'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:05.736837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c079c9a88dd46f6a55d93821f8614ed'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:05.737545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c079c9a88dd46f6a55d93821f8614ed'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:05.751734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1203/2433] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:05 2022] DELETE /identity/v3/users/4c079c9a88dd46f6a55d93821f8614ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:05.756572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:05.757049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:05.757285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:05.775788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:05.776992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:05.840511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1231/2434] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:05.850397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:05.851893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:05.870951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:05.912883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207cfe-9093-49fd-9d46-716d8791385a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:05.917193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:05.917858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:05.918165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:05.918427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:05.927792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:05.929242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:05.941897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1204/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:06.227353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:06.230382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:06.248962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ca780-db19-4650-8cdd-05fbec9a4138 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:06.255507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:06.256445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.256729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.257054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] PATH_INFO: `/v3/projects/7c77645f7b6b4c5c8c97149958f87c56` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.258219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c77645f7b6b4c5c8c97149958f87c56)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:06.261024 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:06.315946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c77645f7b6b4c5c8c97149958f87c56', 'request_id': 'req-47dedff1-f831-4934-bf79-33cc826b9b3b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.325875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c77645f7b6b4c5c8c97149958f87c56', 'request_id': 'req-47dedff1-f831-4934-bf79-33cc826b9b3b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.332494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c77645f7b6b4c5c8c97149958f87c56', 'request_id': 'req-47dedff1-f831-4934-bf79-33cc826b9b3b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.343718 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] The token cache is being invalidate because project 7c77645f7b6b4c5c8c97149958f87c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:06.344003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.344707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.346410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1232/2436] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:06 2022] DELETE /identity/v3/projects/7c77645f7b6b4c5c8c97149958f87c56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:06.350722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:06.360989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a5f-1cc8-42d9-b743-2d9c3af5e776 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:06.433916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:06.434719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.435045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.435320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] PATH_INFO: `/v3/users/2327ec8487f7430da73e75e898c0285f` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.436748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2327ec8487f7430da73e75e898c0285f)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:06.438851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:06.489598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2327ec8487f7430da73e75e898c0285f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.502259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2327ec8487f7430da73e75e898c0285f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.503077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2327ec8487f7430da73e75e898c0285f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.510565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2327ec8487f7430da73e75e898c0285f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.511263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c22c5c1a-0b50-4b38-9a43-91ffffee3d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2327ec8487f7430da73e75e898c0285f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.526381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1205/2437] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:06 2022] DELETE /identity/v3/users/2327ec8487f7430da73e75e898c0285f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:06.812900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:06.814393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:06.827880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dedff1-f831-4934-bf79-33cc826b9b3b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:06.885005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:06.885882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.886160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.886430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] PATH_INFO: `/v3/projects/4ee271e6b0014bffb27d0e5c8da65983` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.887717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee271e6b0014bffb27d0e5c8da65983)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:06.889638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:06.891910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:06.940413 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee271e6b0014bffb27d0e5c8da65983', 'request_id': 'req-138b420b-9fc6-404e-9c9a-557ba8d6c73f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.949812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee271e6b0014bffb27d0e5c8da65983', 'request_id': 'req-138b420b-9fc6-404e-9c9a-557ba8d6c73f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.955682 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee271e6b0014bffb27d0e5c8da65983', 'request_id': 'req-138b420b-9fc6-404e-9c9a-557ba8d6c73f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.967257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] The token cache is being invalidate because project 4ee271e6b0014bffb27d0e5c8da65983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:06.967551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.968214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-138b420b-9fc6-404e-9c9a-557ba8d6c73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.969786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1233/2438] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:06 2022] DELETE /identity/v3/projects/4ee271e6b0014bffb27d0e5c8da65983 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:06.975085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.975579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.975677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.994338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:06.995519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:07.031326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:07.064730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1206/2439] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:07.076145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.076457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.076734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.095435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:07.096646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:07.104851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1234/2440] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:07.109893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.125306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5e65-edf8-485e-a062-40989f6583a0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.133464 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.134427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.134832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.135160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.136224 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:07.136608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.138676 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.150550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1207/2441] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:07.154899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.164827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656a8b-cd46-413c-ab12-19ea872c44df None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.169760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.170449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.170723 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.171028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.171719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.173624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.200654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1235/2442] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:07.204806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.215569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7aa5-41dc-4fa8-b599-591fc0ba7fe9 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.277324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.277921 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.278201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.278480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.279211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.281145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.302346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1208/2443] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:07.306794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.318488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa175d9-431b-4c75-991f-b5847a75782a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.325337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.326013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.326298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.326574 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.327348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.328961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.340575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1236/2444] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:07.344865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.359557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e56f73-bab0-4ddb-aa63-efe656250d32 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.364774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.365436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.365721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.365999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.366732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.368378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee35920-ef29-4a35-8c1a-15b8175352d5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.378613 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1209/2445] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:07.382849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.393055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dbbf7-55ee-4c1e-b38d-dd7596af1132 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.398104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.399022 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.399304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.399580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] PATH_INFO: `/v3/projects/028fc34100b9429db9b60d6513bbac84/users/17a83ee8389b4bab9f378532e4be1cab/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.416426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028fc34100b9429db9b60d6513bbac84, user_id=17a83ee8389b4bab9f378532e4be1cab, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.419374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.437427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1237/2446] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:07 2022] PUT /identity/v3/projects/028fc34100b9429db9b60d6513bbac84/users/17a83ee8389b4bab9f378532e4be1cab/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:07.449284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.449567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.449846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.476591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] MFA Rules not processed for user `17a83ee8389b4bab9f378532e4be1cab`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:07.477808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:07.555376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1210/2447] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:07.616652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.691235 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5525c-34ab-41cc-b6cc-aa601d06e4f8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.696768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.697441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.697725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.697997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.698701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.700719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.727892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1238/2448] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:07.732322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.743463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ccd35-3124-485f-85f6-5eb703c56a97 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.773496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:07.801647 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.802338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.802623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.802933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.803632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.805642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.827080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1211/2449] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:07 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:07.831257 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.841659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b71d1-acc7-48b8-a402-18313096174d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.846532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.847278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.847569 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.847876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.848625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.850666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.863301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1239/2450] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:07.867517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.877798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6feba2-f62c-42c4-976f-e45905872086 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.885994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.887419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.887856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.888130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] PATH_INFO: `/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0/users/dfad7908a6e24ffc882c9f6d0a79bd7d/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:07.904429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfaf99a15774627ba6b8fd67a1265f0, user_id=dfad7908a6e24ffc882c9f6d0a79bd7d, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:07.907147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:07.922887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1212/2451] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:07 2022] PUT /identity/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0/users/dfad7908a6e24ffc882c9f6d0a79bd7d/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:07.927148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.932881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:07.938727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ba07-f9d9-4d23-b919-bfa744218adc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.998658 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:07.999365 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:07.999652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:07.999924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.000633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.002253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e131f25-5e81-455e-9f14-eb1768460821 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.012443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1240/2452] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:08.016914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:08.028017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371dd7-e352-4183-8d47-5c73e3bf41b1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:08.033022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:08.033910 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.034187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.034458 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] PATH_INFO: `/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0/users/dfad7908a6e24ffc882c9f6d0a79bd7d/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.036573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfaf99a15774627ba6b8fd67a1265f0, user_id=dfad7908a6e24ffc882c9f6d0a79bd7d, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.039268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.050081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1213/2453] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:08 2022] PUT /identity/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0/users/dfad7908a6e24ffc882c9f6d0a79bd7d/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:08.061310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.061543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.061874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.094623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] MFA Rules not processed for user `dfad7908a6e24ffc882c9f6d0a79bd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:08.095881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.175615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1241/2454] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:08.183139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:08.185020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.270737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280664e-400f-4051-9a9d-ed6ed0819f10 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:08.274771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:08.275452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.275737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.276034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.285694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.287178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d9c2-4123-4781-85a6-2a972a3b1096 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.296839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1214/2455] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:08.681547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:08.752661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04884c1-3cc5-4b6c-bd68-5d2d56c98a11 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:08.757902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:08.758813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.759098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.759374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] PATH_INFO: `/v3/users/17a83ee8389b4bab9f378532e4be1cab` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.760867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a83ee8389b4bab9f378532e4be1cab)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.762860 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.792147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:08.813021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a83ee8389b4bab9f378532e4be1cab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.826817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a83ee8389b4bab9f378532e4be1cab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.827501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a83ee8389b4bab9f378532e4be1cab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.835464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a83ee8389b4bab9f378532e4be1cab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.836057 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a83ee8389b4bab9f378532e4be1cab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.851523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1242/2456] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:08 2022] DELETE /identity/v3/users/17a83ee8389b4bab9f378532e4be1cab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:08.856274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.856562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.856837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.874952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:08.876333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.945478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1215/2457] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:08.955458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:08.957027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.022994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369661a-7c95-4b04-a7c2-d876275a2673 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.027220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.027874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.028161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.028436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.038311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.039810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.049724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1243/2458] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:09.351293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.352803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.365021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e667-2ec0-46b0-9496-22579a885172 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.369899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.370976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.371266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.371542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] PATH_INFO: `/v3/projects/028fc34100b9429db9b60d6513bbac84` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.372877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028fc34100b9429db9b60d6513bbac84)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.374954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.377567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:09.431706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028fc34100b9429db9b60d6513bbac84', 'request_id': 'req-92219745-8c48-4427-a67c-522d2dd84838'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.439504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028fc34100b9429db9b60d6513bbac84', 'request_id': 'req-92219745-8c48-4427-a67c-522d2dd84838'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.446305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028fc34100b9429db9b60d6513bbac84', 'request_id': 'req-92219745-8c48-4427-a67c-522d2dd84838'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.457415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] The token cache is being invalidate because project 028fc34100b9429db9b60d6513bbac84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:09.457709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.458441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.460151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1216/2459] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:09 2022] DELETE /identity/v3/projects/028fc34100b9429db9b60d6513bbac84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:09.464346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.474659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb5aa8-b703-4eba-8196-3b848ddf08e0 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.535001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.536352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.536684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.537035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] PATH_INFO: `/v3/users/dfad7908a6e24ffc882c9f6d0a79bd7d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.539076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfad7908a6e24ffc882c9f6d0a79bd7d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.542189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.595741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfad7908a6e24ffc882c9f6d0a79bd7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.597110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:09.612379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfad7908a6e24ffc882c9f6d0a79bd7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.613118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfad7908a6e24ffc882c9f6d0a79bd7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.620250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfad7908a6e24ffc882c9f6d0a79bd7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.620880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37040bd5-66d5-409a-8379-f373160a50e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfad7908a6e24ffc882c9f6d0a79bd7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:09.635897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1244/2460] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:09 2022] DELETE /identity/v3/users/dfad7908a6e24ffc882c9f6d0a79bd7d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:09.920559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.922128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.936104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219745-8c48-4427-a67c-522d2dd84838 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.995962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.997073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.997361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.997634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] PATH_INFO: `/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.998866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfaf99a15774627ba6b8fd67a1265f0)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.000793 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.049611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfaf99a15774627ba6b8fd67a1265f0', 'request_id': 'req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.058240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfaf99a15774627ba6b8fd67a1265f0', 'request_id': 'req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.064602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfaf99a15774627ba6b8fd67a1265f0', 'request_id': 'req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.075895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] The token cache is being invalidate because project 3cfaf99a15774627ba6b8fd67a1265f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:10.076177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.076850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-86506be7-ea2b-4eaa-a319-e1bd3a95d5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.078444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1217/2461] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:09 2022] DELETE /identity/v3/projects/3cfaf99a15774627ba6b8fd67a1265f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:10.083566 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.084093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.084093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.102692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.103925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.163479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1245/2462] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:10.171862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.172153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.172430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.191460 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.192599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.202201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1218/2463] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:10.206623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.216899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0308-0751-4d00-a837-2e75158b7a10 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.222815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.223617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.223768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.224062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.224799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:10.225108 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.226739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.239034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1246/2464] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:10.243469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.252877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8565fa-3789-41ce-a496-e071d863f0eb None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.258326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.259025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.259302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.259579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.260272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.262199 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.280754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:10.297143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1219/2465] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:10.301516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.311786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352909a-e67f-4156-aa8f-0edc90bdb7cc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.372883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.373559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.373840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.374111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.374816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.376771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.398228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1247/2466] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:10.403997 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.416700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331581-89a7-4a1c-9622-b5204f0ac636 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.422221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.422984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.423267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.423644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.424436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.426078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.436747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1220/2467] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:10.441178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.451823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d015c5-9f55-4eff-8c2b-12db050504db admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.457106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.457766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.458046 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.458316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.459102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.460725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afe6c-f9fb-4af0-8e45-bd90af8d547e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.470943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1248/2468] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:10.475101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.485532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0b4c-fc58-43a4-b2e5-01133cbcc5d0 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.490769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.491720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.492026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.492278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] PATH_INFO: `/v3/projects/387eb880ef3745f8a59ccbf20729517f/users/80a0bd3401ea45c89af74d13b32f9a15/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.507905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387eb880ef3745f8a59ccbf20729517f, user_id=80a0bd3401ea45c89af74d13b32f9a15, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.510571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.528021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1221/2469] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:10 2022] PUT /identity/v3/projects/387eb880ef3745f8a59ccbf20729517f/users/80a0bd3401ea45c89af74d13b32f9a15/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:10.540324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.540594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.540870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.571512 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] MFA Rules not processed for user `80a0bd3401ea45c89af74d13b32f9a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.572727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.597328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:10.649793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1249/2470] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:10.662804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.664841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.725252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cada3-a88b-4475-95f6-f0479c950bd5 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.729896 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.730559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.730868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.731144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.740945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.742407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0873775-d4a0-4395-bb7f-e96207207d14 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.751930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1222/2471] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:10.772206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.842797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df71c-5193-4459-9b63-777b731e2051 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.847789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.848667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.848954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.849233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] PATH_INFO: `/v3/users/80a0bd3401ea45c89af74d13b32f9a15` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.850463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a0bd3401ea45c89af74d13b32f9a15)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.852455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.903583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a0bd3401ea45c89af74d13b32f9a15'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.915925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a0bd3401ea45c89af74d13b32f9a15'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.916662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a0bd3401ea45c89af74d13b32f9a15'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.923650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a0bd3401ea45c89af74d13b32f9a15'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.924325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a0bd3401ea45c89af74d13b32f9a15'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.941433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1250/2472] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:10 2022] DELETE /identity/v3/users/80a0bd3401ea45c89af74d13b32f9a15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:10.947974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.948268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.948547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.966393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.967636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.028202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1223/2473] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:11.038097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.039748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.086451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:11.102282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b68baa-e30f-4718-a860-b92f5cd8165e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.106313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.107014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.107304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.107581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.117145 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.118653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bce82-7e6c-419d-93fa-1bd9fe319f9e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.128624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1251/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:11.647363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.648850 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.663787 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5a1a0-b941-48c5-9489-e4704099d832 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.670535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.671511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.671797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.672084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] PATH_INFO: `/v3/projects/387eb880ef3745f8a59ccbf20729517f` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.673312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387eb880ef3745f8a59ccbf20729517f)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.675309 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.727465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387eb880ef3745f8a59ccbf20729517f', 'request_id': 'req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:11.735739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387eb880ef3745f8a59ccbf20729517f', 'request_id': 'req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:11.736918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:11.744084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387eb880ef3745f8a59ccbf20729517f', 'request_id': 'req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:11.755313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] The token cache is being invalidate because project 387eb880ef3745f8a59ccbf20729517f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:11.755603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:11.756262 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-587ea64d-91ec-4ac7-866f-4fc7fbf3f0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:11.757826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1224/2475] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:11 2022] DELETE /identity/v3/projects/387eb880ef3745f8a59ccbf20729517f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:11.762873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.763171 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.763453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.782161 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:11.783414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.851845 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1252/2476] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:11.860852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.861246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.861599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.887443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:11.888692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.897539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1225/2477] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:11.901912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.912004 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89607d-dbe7-43e9-8858-dc5c42424f0f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.918678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.919798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.920133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.920404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.921138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:11.921455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.923094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.935136 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1253/2478] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:11.939536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.949924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85c0ca-8007-4fe7-9ee6-764cbbbfe1b1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.955358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.956009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.956285 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.956554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.957261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.959185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.990453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1226/2479] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:11.994552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.004788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a100c0-3f7b-4582-93e2-5d5877d4d437 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.070310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.071015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.071288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.071556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.072239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.074144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.094608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1254/2480] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:12.099012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.109361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342fd3e-5e2d-4d8e-8e09-c3833ede0430 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.114328 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.115031 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.115313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.115587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.116323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.117963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.128796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1227/2481] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:12.133537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.148418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a32d5-d023-449c-a5ea-e3b9678c257d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.154373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.155072 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.155348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.155587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.156313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.157910 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646bbe-a693-4f31-871a-d22f83830b68 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.168311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1255/2482] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:12.172585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.182926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef8155-8efb-4772-8a74-642447c1fcbd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.187814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.188706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.188970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.189274 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] PATH_INFO: `/v3/projects/7bda5bf02cb94fffa2d71bc5c8c00012/users/964cff6534bb4cd4b450a8249a06847f/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.205175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5bf02cb94fffa2d71bc5c8c00012, user_id=964cff6534bb4cd4b450a8249a06847f, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.207990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.222376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1228/2483] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:12 2022] PUT /identity/v3/projects/7bda5bf02cb94fffa2d71bc5c8c00012/users/964cff6534bb4cd4b450a8249a06847f/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:12.232939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.233227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.233502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.260968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] MFA Rules not processed for user `964cff6534bb4cd4b450a8249a06847f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:12.262165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:12.301861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:12.332817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1256/2484] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:12.344029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.345900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:12.407440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c0197-d7e1-42a9-9a16-19a8698c3625 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.411250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.411900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.412180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.412454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.420868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.422310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469873ff-f827-431d-ae5b-f8003eb08e19 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.431265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1229/2485] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:15.477750 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:15.544748 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d385d3-dfa0-4c7e-80a9-5ef4ab083d0c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:15.550377 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:15.551285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:15.551557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:15.551830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] PATH_INFO: `/v3/users/964cff6534bb4cd4b450a8249a06847f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:15.553088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964cff6534bb4cd4b450a8249a06847f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:15.555088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:15.612729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964cff6534bb4cd4b450a8249a06847f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:15.630035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964cff6534bb4cd4b450a8249a06847f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:15.630898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964cff6534bb4cd4b450a8249a06847f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:15.637984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964cff6534bb4cd4b450a8249a06847f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:15.638873 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964cff6534bb4cd4b450a8249a06847f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:15.658282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1257/2486] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:15 2022] DELETE /identity/v3/users/964cff6534bb4cd4b450a8249a06847f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:15.664260 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:15.664802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:15.664802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:15.682802 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:15.683534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:15.748493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1230/2487] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:15.758418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:15.760051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:15.821916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e865be-a4c4-4a7f-bac2-2d6e78209348 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:15.825894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:15.826542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:15.826816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:15.827122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:15.836561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:15.838031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284039-a9d5-4c3c-8c62-9351f5c1103d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:15.843140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:15.848819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1258/2488] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:16.138263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:16.139725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:16.152099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b7cfa-4cf8-48f9-91cd-b76672e58d2a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:16.156817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:16.157716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:16.157992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:16.158265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] PATH_INFO: `/v3/projects/7bda5bf02cb94fffa2d71bc5c8c00012` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:16.159504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bda5bf02cb94fffa2d71bc5c8c00012)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:16.161671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:16.183475 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:16.209638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bda5bf02cb94fffa2d71bc5c8c00012', 'request_id': 'req-a446e1f8-5b75-4c46-9906-eb7e5bf27587'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:16.216842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bda5bf02cb94fffa2d71bc5c8c00012', 'request_id': 'req-a446e1f8-5b75-4c46-9906-eb7e5bf27587'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:16.223239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bda5bf02cb94fffa2d71bc5c8c00012', 'request_id': 'req-a446e1f8-5b75-4c46-9906-eb7e5bf27587'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:16.233642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] The token cache is being invalidate because project 7bda5bf02cb94fffa2d71bc5c8c00012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:16.233923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:16.234570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:16.236082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1231/2489] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:16 2022] DELETE /identity/v3/projects/7bda5bf02cb94fffa2d71bc5c8c00012 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:26.230928 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:51.484513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a903-a33a-48ed-ab5d-c74f7606fdf7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:51.485000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a903-a33a-48ed-ab5d-c74f7606fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:51.485103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a903-a33a-48ed-ab5d-c74f7606fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:51.515048 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9f31a903-a33a-48ed-ab5d-c74f7606fdf7 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:51.516268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9f31a903-a33a-48ed-ab5d-c74f7606fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:51.579973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1259/2490] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:51.631032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:51.633214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:51.709585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446e1f8-5b75-4c46-9906-eb7e5bf27587 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:51.717441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:51.718109 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:51.718394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:51.718672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:51.727932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:51.729528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28dc05-a25d-4f7f-8cd0-a18656bdc682 service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:51.738154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1232/2491] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:40:01.572356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=32 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:01.734455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=32 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:13.315831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.316354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.316485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.318376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1260/2492] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:13.324740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b503-4ce7-4329-9e39-606c9fc7b63e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.325207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b503-4ce7-4329-9e39-606c9fc7b63e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.325432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b503-4ce7-4329-9e39-606c9fc7b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.357511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5e21b503-4ce7-4329-9e39-606c9fc7b63e None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:13.358747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5e21b503-4ce7-4329-9e39-606c9fc7b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.439263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1233/2493] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:13.451253 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:13.453132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.511039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf59295-bfdf-4c12-8ccc-fcc8c8b55a4f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:13.515314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:13.516236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.516508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.516784 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.527708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:13.529196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279629-5b93-40d6-8f2e-d631429f6ceb service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:13.540451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1261/2494] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:13.612842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.613127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.613397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] PATH_INFO: `/` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.614806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1234/2495] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:13.619690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c7a7-11ae-4555-99c4-0d3e66c135f9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.619985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c7a7-11ae-4555-99c4-0d3e66c135f9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.620263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c7a7-11ae-4555-99c4-0d3e66c135f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.639775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8ad6c7a7-11ae-4555-99c4-0d3e66c135f9 None None] MFA Rules not processed for user `3386325f72224ab1b9719855b1fbbdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:13.641044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8ad6c7a7-11ae-4555-99c4-0d3e66c135f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.693018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1262/2496] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:13.706355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:13.708355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.722710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228804ab-03f0-420c-a8bb-bdf59de55d49 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:13.726852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:13.727522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.727800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.728072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.735341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:13.736762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360bcd-58f8-4884-84b4-f446aeba02e6 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:13.744366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1235/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:13.827638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214de5-689f-4086-9f10-1578b53d669a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.827939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214de5-689f-4086-9f10-1578b53d669a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.828285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214de5-689f-4086-9f10-1578b53d669a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.829695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1263/2498] 10.222.0.57 () {54 vars in 921 bytes} [Fri Jul 15 19:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:13.835239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d0b0-24b6-48e8-83ed-0059e46dbe90 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.835531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d0b0-24b6-48e8-83ed-0059e46dbe90 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.835809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d0b0-24b6-48e8-83ed-0059e46dbe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.855348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3555d0b0-24b6-48e8-83ed-0059e46dbe90 None None] MFA Rules not processed for user `1876435c9cdf4e11a6d193017d53ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:13.856588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3555d0b0-24b6-48e8-83ed-0059e46dbe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.867396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1236/2499] 10.222.0.57 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:13.878260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214de5-689f-4086-9f10-1578b53d669a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:13.891214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214de5-689f-4086-9f10-1578b53d669a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:13.895579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:13.896223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.896469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.896754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.910520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:13.912211 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:13.926973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1264/2500] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:16.023625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.024104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.024290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.042111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:16.043370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:16.050801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1237/2501] 10.222.0.57 () {58 vars in 1009 bytes} [Fri Jul 15 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:16.076577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:16.089681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dddf9-ae0f-4338-9478-273553733a84 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:16.096027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:16.096621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.096900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.097166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.106228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:16.107424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeecd7d-ae61-4907-b726-be149d947354 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:16.115979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1265/2502] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:40:26.036962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=52 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.112690 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=61 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:36.228795 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:36.230519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:36.249519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8568e-e59b-4db9-b115-d5df4436bca0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:36.253273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:36.253930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:36.254208 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:36.254480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:36.256480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:36.329630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:36.331114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:36.342454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1238/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:36.385961 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:36.386503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:36.386503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:36.404756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] MFA Rules not processed for user `fdd35b9fb29349c7a22af2380310e6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:36.405988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:36.413469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1266/2504] 10.222.0.57 () {58 vars in 967 bytes} [Fri Jul 15 19:40:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:36.426808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:36.438351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5726-8f33-42e0-a4b6-8a2c1241c956 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:36.444273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe289a5fd69404786a12a13e43bd697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:36.444932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:36.445209 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:36.445494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:36.456651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:36.458252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:36.466870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1239/2505] 10.222.0.57 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:40:39.605581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:39.607305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:39.626981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c587301-bd6c-43e6-9468-d89ba4f0527c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:39.631471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:39.632369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:39.632649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:39.632930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] PATH_INFO: `/v3/users/bb1c4b49c3cb4fd8b45e4233f431b741` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:39.634129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1c4b49c3cb4fd8b45e4233f431b741)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:39.636243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:39.682583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1c4b49c3cb4fd8b45e4233f431b741'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:39.696661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1c4b49c3cb4fd8b45e4233f431b741'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:39.697344 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1c4b49c3cb4fd8b45e4233f431b741'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:39.704299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1c4b49c3cb4fd8b45e4233f431b741'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:39.704933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dc0a66-97b4-486b-8dcb-757f1fda3819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1c4b49c3cb4fd8b45e4233f431b741'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:39.720016 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1267/2506] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:39 2022] DELETE /identity/v3/users/bb1c4b49c3cb4fd8b45e4233f431b741 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:40:39.899407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:39.910965 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f391b-8177-4e0b-8399-7b6c51f3b95b service swift] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:39.971480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:39.972408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:39.972688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:39.972994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] PATH_INFO: `/v3/projects/6f658a8dac5b4469ba8528795304a004` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:39.974215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f658a8dac5b4469ba8528795304a004)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:39.976186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.024172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f658a8dac5b4469ba8528795304a004', 'request_id': 'req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:40.032265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f658a8dac5b4469ba8528795304a004', 'request_id': 'req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:40.038501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f658a8dac5b4469ba8528795304a004', 'request_id': 'req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:40.048448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] The token cache is being invalidate because project 6f658a8dac5b4469ba8528795304a004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:40.048732 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:40.049363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-db1feac8-0dfb-4004-b61d-8c1bd61ffe98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:40.050939 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1240/2507] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:39 2022] DELETE /identity/v3/projects/6f658a8dac5b4469ba8528795304a004 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:40.056226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.056534 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.056807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.076189 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:40.077375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.138659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1268/2508] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:40.147495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.147721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.148044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.171235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:40.172463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.182203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1241/2509] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:40.186565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.197856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9d5f-4d2b-4455-87ed-e71b60b599d7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.204086 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.204731 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.205010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.205282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.206013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:40:40.206372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.208040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.220516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1269/2510] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:40:40.225073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.230823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:40.234989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ca5c-7369-4581-b67b-51f8c7766c00 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.242239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.243129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.243592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.243881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.244723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.247137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.274880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1242/2511] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:40.279801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.290123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b9490-3578-4d17-abe6-97ea2f116964 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.340371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:40.351373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.352342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.352637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.353092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.353818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.356036 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.376992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1270/2512] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:40:40.381431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.392191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e0090-528c-4fba-882a-e535d5ff23d1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.397881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.398481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.398765 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.399100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.399837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.401481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.412690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1243/2513] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:40:40.416870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.427372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d82e6-8fc2-439a-b3dc-c77a9c6c0ef9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.432575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.433240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.433528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.433805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.434579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.436250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd2327-3068-4123-90fc-f6d569ed13b3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.447083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1271/2514] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:40.451440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.463671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e19388-d51f-4d66-88da-8d97f6206470 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.468863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.469746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.470030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.470261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] PATH_INFO: `/v3/projects/c0398b1ce1ce483d8b8f80c04b115902/users/c40e196aaa194ac3a8c28ec5fa461825/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.486594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0398b1ce1ce483d8b8f80c04b115902, user_id=c40e196aaa194ac3a8c28ec5fa461825, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.489391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.504022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1244/2515] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:40 2022] PUT /identity/v3/projects/c0398b1ce1ce483d8b8f80c04b115902/users/c40e196aaa194ac3a8c28ec5fa461825/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:40.515198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.515537 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.515915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.550945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] MFA Rules not processed for user `c40e196aaa194ac3a8c28ec5fa461825`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:40.552175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.619012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1272/2516] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:40.630903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.632685 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.714661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a692ecb-adff-49c1-bfd7-a0f648f77f75 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.721035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.721691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.722032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.722313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.730350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.731989 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f088b-ac07-4e1a-b56c-7b73b006ef88 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.741201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1245/2517] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:43.493634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:43.557383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483ee3-ddde-48ca-a091-8ddc5940b289 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:43.562693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:43.563611 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:43.563885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:43.564155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] PATH_INFO: `/v3/users/c40e196aaa194ac3a8c28ec5fa461825` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:43.565408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40e196aaa194ac3a8c28ec5fa461825)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:43.567408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:43.616702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40e196aaa194ac3a8c28ec5fa461825'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:43.627968 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:43.629415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40e196aaa194ac3a8c28ec5fa461825'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:43.630186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40e196aaa194ac3a8c28ec5fa461825'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:43.638909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40e196aaa194ac3a8c28ec5fa461825'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:43.639921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40e196aaa194ac3a8c28ec5fa461825'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:43.653585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1273/2518] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:43 2022] DELETE /identity/v3/users/c40e196aaa194ac3a8c28ec5fa461825 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:43.658358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:43.658852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:43.658987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:43.675762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:43.677035 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:43.736932 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1246/2519] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:43.746815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:43.748517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:43.810191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad957a7d-49ed-44c5-88a2-0c4671fc8105 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:43.814055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:43.814712 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:43.815013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:43.815278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:43.824847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:43.826285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cbde-3f6e-4821-9efd-847305bbde84 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:43.835922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1274/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:44.103250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.104727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:44.117524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0071d-c49f-4cd9-8cbd-cd358da76a46 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.122774 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.123701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.123992 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.124269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] PATH_INFO: `/v3/projects/c0398b1ce1ce483d8b8f80c04b115902` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.125571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0398b1ce1ce483d8b8f80c04b115902)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.127556 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.164098 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:44.180760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0398b1ce1ce483d8b8f80c04b115902', 'request_id': 'req-fa541c2a-9339-4a41-90c1-ea1f7378bb34'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:44.188639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0398b1ce1ce483d8b8f80c04b115902', 'request_id': 'req-fa541c2a-9339-4a41-90c1-ea1f7378bb34'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:44.195867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0398b1ce1ce483d8b8f80c04b115902', 'request_id': 'req-fa541c2a-9339-4a41-90c1-ea1f7378bb34'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:44.207060 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] The token cache is being invalidate because project c0398b1ce1ce483d8b8f80c04b115902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:44.207347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:44.208068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fa541c2a-9339-4a41-90c1-ea1f7378bb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:44.209632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1247/2521] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:44 2022] DELETE /identity/v3/projects/c0398b1ce1ce483d8b8f80c04b115902 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:44.214806 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.215090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.215362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.234255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:44.235511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:44.299442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1275/2522] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:44.307317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.307612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.307894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.327534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:44.328754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:44.337477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1248/2523] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:44.341859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.352371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2c009-54ce-4ae2-ad66-c86fabc45d6d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.358331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.359035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.359313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.359580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.360324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:40:44.360636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.362424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.379012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1276/2524] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:40:44.383778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.394044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a9e1-a2db-4e3d-b1d2-3c4da45e9f4d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.400602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.401258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.401530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.401801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.402484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.404419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.438686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1249/2525] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:44.444236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.460540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c86d-1418-4471-b625-f954a2dc15af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.524619 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.525435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.525698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.525974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.526663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.528626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.546392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:44.552196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1277/2526] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:44.556141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.567387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10531b-1476-4774-bdf5-ceb6899bc021 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.572360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.573025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.573306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.573579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.574302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.575951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.586462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1250/2527] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:44.590418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.600870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f22f-c56e-4904-bd5f-6051b9282f4d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.605669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.606362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.606643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.606957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.607694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.609300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64947f43-8e12-4d35-9006-49673ffc31fd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.619464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1278/2528] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:44.623514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.633511 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766ff6-afb9-4483-8281-759ecb487d03 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.638940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.639919 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.640320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.640602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] PATH_INFO: `/v3/projects/a54b8dc632f84a51b9c9fb4325b888cf/users/c9868579746b4518b1db551c228195a9/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.656578 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54b8dc632f84a51b9c9fb4325b888cf, user_id=c9868579746b4518b1db551c228195a9, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.659313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.675227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1251/2529] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:44 2022] PUT /identity/v3/projects/a54b8dc632f84a51b9c9fb4325b888cf/users/c9868579746b4518b1db551c228195a9/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:44.687091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.687380 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.687679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.720390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] MFA Rules not processed for user `c9868579746b4518b1db551c228195a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:44.721629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:44.789930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1279/2530] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:44.794588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.860253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d1ada-f7af-4ecb-8851-e0472935ef4e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.867832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.868742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.869122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.869489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.870496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.873116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:44.909868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1252/2531] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:44.914649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:44.929606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b0a7-7eb4-4f7b-acbb-73f3c6842b7f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:44.991075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:44.991767 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:44.992047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:44.992322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:44.993033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:44.995017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.015807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1280/2532] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:44 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:40:45.019886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.030697 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812df8-b55c-4090-a535-c8f7a91cb2af admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.036589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.037259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.037539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.037813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.038551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.040590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.053223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1253/2533] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:45.058333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.074449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2cb9-4c63-4b9c-80c7-03dbaa552450 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.083300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.084206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.084492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.084770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] PATH_INFO: `/v3/projects/9606810696534b73a6a4a6f064521b98/users/eb0d297e63e640e9b4a682d15555bbfa/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.100799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9606810696534b73a6a4a6f064521b98, user_id=eb0d297e63e640e9b4a682d15555bbfa, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.103524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.119920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1281/2534] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:45 2022] PUT /identity/v3/projects/9606810696534b73a6a4a6f064521b98/users/eb0d297e63e640e9b4a682d15555bbfa/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:45.125923 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.136940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed927-1256-42b5-8a46-f0ecf8f69f84 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.162029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:45.198457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.199184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.199468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.199739 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.200471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.202120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f45cf-fc0a-49af-b9f0-81255608a0ac admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.212708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1254/2535] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:45.217061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.228620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df2efa-d5db-4df5-8443-f539b07624b3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.234392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.235342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.235628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.235909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] PATH_INFO: `/v3/projects/9606810696534b73a6a4a6f064521b98/users/eb0d297e63e640e9b4a682d15555bbfa/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.237995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9606810696534b73a6a4a6f064521b98, user_id=eb0d297e63e640e9b4a682d15555bbfa, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.240711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.251354 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1282/2536] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:45 2022] PUT /identity/v3/projects/9606810696534b73a6a4a6f064521b98/users/eb0d297e63e640e9b4a682d15555bbfa/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:45.261579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.261871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.262144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.289419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] MFA Rules not processed for user `eb0d297e63e640e9b4a682d15555bbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:45.290654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:45.362447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1255/2537] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:45.373614 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.375606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:45.417776 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:45.443562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe63a-d6b9-4f1d-8f08-22a9b054baed admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.447665 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.448327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.448609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.448887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.458141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.459642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce7d84-ea98-4e75-8bbe-dd6313cf9f0e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.469279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1283/2538] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:45.613236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.684030 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa756e-0e00-43f7-ad47-234ac1ba778c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.689495 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.690393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.690679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.690990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] PATH_INFO: `/v3/users/c9868579746b4518b1db551c228195a9` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.692436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9868579746b4518b1db551c228195a9)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.694917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.746835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9868579746b4518b1db551c228195a9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:45.748759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:45.761261 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9868579746b4518b1db551c228195a9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:45.762124 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9868579746b4518b1db551c228195a9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:45.769115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9868579746b4518b1db551c228195a9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:45.769755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9868579746b4518b1db551c228195a9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:45.783203 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1256/2539] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:45 2022] DELETE /identity/v3/users/c9868579746b4518b1db551c228195a9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:45.787930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.788409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.788633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.806297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:45.807519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:45.869927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1284/2540] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:45.879985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:45.881653 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:45.941429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579a1e-3634-4f0d-8428-e72b23403061 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:45.946102 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:45.946748 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:45.947085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:45.947332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:45.957181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:45.958621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:45.967893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1257/2541] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:46.236920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:46.238474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:46.253888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac05a-c379-4918-b747-23bff4967fa5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:46.261204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:46.262295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:46.262692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:46.263109 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] PATH_INFO: `/v3/projects/a54b8dc632f84a51b9c9fb4325b888cf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:46.264584 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54b8dc632f84a51b9c9fb4325b888cf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:46.266592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:46.449655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54b8dc632f84a51b9c9fb4325b888cf', 'request_id': 'req-3e63387f-7066-4bab-9f34-cecdd98a52d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.462185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54b8dc632f84a51b9c9fb4325b888cf', 'request_id': 'req-3e63387f-7066-4bab-9f34-cecdd98a52d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.468669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54b8dc632f84a51b9c9fb4325b888cf', 'request_id': 'req-3e63387f-7066-4bab-9f34-cecdd98a52d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.480524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] The token cache is being invalidate because project a54b8dc632f84a51b9c9fb4325b888cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:46.480752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.481393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.483031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1285/2542] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:46 2022] DELETE /identity/v3/projects/a54b8dc632f84a51b9c9fb4325b888cf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:46.487768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:46.499265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f72df-1d43-4da3-a2a8-ea552f243a90 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:46.559972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:46.560871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:46.561148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:46.561417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] PATH_INFO: `/v3/users/eb0d297e63e640e9b4a682d15555bbfa` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:46.562641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0d297e63e640e9b4a682d15555bbfa)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:46.564598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:46.614759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0d297e63e640e9b4a682d15555bbfa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.631918 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0d297e63e640e9b4a682d15555bbfa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.632731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0d297e63e640e9b4a682d15555bbfa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.640190 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:46.642977 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0d297e63e640e9b4a682d15555bbfa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.644251 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-c15afab0-cc92-4690-95d2-d32a72d2ab8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0d297e63e640e9b4a682d15555bbfa'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:46.658800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1258/2543] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:46 2022] DELETE /identity/v3/users/eb0d297e63e640e9b4a682d15555bbfa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:46.932930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:46.934487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:46.948411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63387f-7066-4bab-9f34-cecdd98a52d2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.016378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:47.024641 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.025679 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.025957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.026255 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] PATH_INFO: `/v3/projects/9606810696534b73a6a4a6f064521b98` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.027822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9606810696534b73a6a4a6f064521b98)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.029919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.080462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9606810696534b73a6a4a6f064521b98', 'request_id': 'req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:47.089595 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9606810696534b73a6a4a6f064521b98', 'request_id': 'req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:47.095465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9606810696534b73a6a4a6f064521b98', 'request_id': 'req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:47.110066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] The token cache is being invalidate because project 9606810696534b73a6a4a6f064521b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:47.110466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:47.111577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-982c0c86-6a99-4a2b-965e-d0d0fa00fdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:47.113764 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1286/2544] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:46 2022] DELETE /identity/v3/projects/9606810696534b73a6a4a6f064521b98 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:47.118915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.119397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.119490 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.138378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:47.139625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:47.203731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1259/2545] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:47.213195 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.213479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.213749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.233282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:47.234485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:47.244096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1287/2546] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:47.248859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.261577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb0a7-fc5a-4dd9-a5c6-64354078d324 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.267899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.268611 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.268891 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.269221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.269975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:40:47.270279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.272066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.284027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1260/2547] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:40:47.288514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.297900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9ecd-eca0-40e4-9dee-21602e2eefe1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.303451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.304107 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.304383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.304650 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.305334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.307242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.335992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1288/2548] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:47.340389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.351020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021641-9c23-4cf1-a92a-05eb453ecf08 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.410610 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.411317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.411631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.411908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.412603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.414625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.436555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1261/2549] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:47.442695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.454726 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad5f6-efa3-493f-a84d-5deadb3f3554 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.460843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.461788 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.462076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.462346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.463118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.464721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.475789 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1289/2550] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:47.481567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.495122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941da0c7-9c96-4f0d-a0cb-e771f8f9f041 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.504243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.505110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.505493 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.505900 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.507115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.508766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff86e-7948-4912-82b0-efa3d452e39b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.521279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1262/2551] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:47.525339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.536174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312923f-fc07-427c-98c3-50151829c6b9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.542439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.543356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.543630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.543896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] PATH_INFO: `/v3/projects/10d103eb2f7c48f883c58b7303ba92a8/users/cc1faa8297b64613be20bd51236f640d/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.559999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d103eb2f7c48f883c58b7303ba92a8, user_id=cc1faa8297b64613be20bd51236f640d, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.562697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.577831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1290/2552] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:47 2022] PUT /identity/v3/projects/10d103eb2f7c48f883c58b7303ba92a8/users/cc1faa8297b64613be20bd51236f640d/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:47.593150 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.593521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.593817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.622593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] MFA Rules not processed for user `cc1faa8297b64613be20bd51236f640d`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:47.623852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:47.671539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:47.693945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1263/2553] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:47.698678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.762375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8379-0dbf-440c-a78a-ba786e518a3e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.768028 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.768691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.768969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.769234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.769916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.771915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.803063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:47.810159 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1291/2554] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:47.814223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.825143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a9c3d-7d9c-461a-94bc-53bec52aab21 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.885399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.886367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.886766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.887211 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.888302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.891444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.915892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1264/2555] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:47 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:47.920232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.930728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2a18-569a-4fa4-a9f8-8cc777a62926 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.935395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.936061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.936333 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.936599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.937323 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.938952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:47.949318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1292/2556] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:47.953423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:47.963667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741590-221a-4b7a-8626-0ce68c7f1b50 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:47.968895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:47.969833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:47.970114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:47.970387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] PATH_INFO: `/v3/projects/c10e5337a59f4c109f87507ecadcd355/users/c51fb90cdd8f4c81884f7e94bb2dae7e/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:47.987616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10e5337a59f4c109f87507ecadcd355, user_id=c51fb90cdd8f4c81884f7e94bb2dae7e, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:47.990624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:48.003956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1265/2557] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:47 2022] PUT /identity/v3/projects/c10e5337a59f4c109f87507ecadcd355/users/c51fb90cdd8f4c81884f7e94bb2dae7e/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:40:48.007997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:48.017897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9cd1-b75f-47be-b79c-7fe0c9069196 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:48.080998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:48.081622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:48.081880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:48.082127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:48.082893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:48.084508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c53b-3c22-4fc6-b40c-65e0044e9967 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:48.094689 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1293/2558] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:48.099085 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:48.110970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07a84-1400-4de6-a52d-e47d8e8a210f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:48.116197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:48.117594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:48.117916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:48.118281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] PATH_INFO: `/v3/projects/c10e5337a59f4c109f87507ecadcd355/users/c51fb90cdd8f4c81884f7e94bb2dae7e/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:48.121794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10e5337a59f4c109f87507ecadcd355, user_id=c51fb90cdd8f4c81884f7e94bb2dae7e, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:48.125826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:48.139197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1266/2559] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:48 2022] PUT /identity/v3/projects/c10e5337a59f4c109f87507ecadcd355/users/c51fb90cdd8f4c81884f7e94bb2dae7e/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:48.149572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:48.149899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:48.150179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:48.178892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] MFA Rules not processed for user `c51fb90cdd8f4c81884f7e94bb2dae7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:48.180095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:48.250177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1294/2560] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:48.262169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:48.264353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:48.323789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314011-f298-4deb-98e2-7ac4d8240567 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:48.328118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:48.328764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:48.329045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:48.329321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:48.339269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:48.340649 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:48.351494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1267/2561] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:48.397312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:48.398805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:48.411049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae4fba-f4d4-4d85-94d2-77d49aa83ec3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:48.415096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:48.415743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:48.416010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:48.416284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:48.475941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:48.477399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ba2b2-1382-494a-b681-95def214e747 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:48.488916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1295/2562] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:51.855156 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:51.899033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:51.920062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6305a-fed0-4ed2-b193-e315173a9c2f service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:51.925151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:51.926038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:51.926316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:51.926590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] PATH_INFO: `/v3/users/cc1faa8297b64613be20bd51236f640d` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:51.927884 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1faa8297b64613be20bd51236f640d)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:51.929817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:51.980456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1faa8297b64613be20bd51236f640d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:51.992168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1faa8297b64613be20bd51236f640d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:51.992864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1faa8297b64613be20bd51236f640d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:51.999608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1faa8297b64613be20bd51236f640d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.000253 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1faa8297b64613be20bd51236f640d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.013268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1268/2563] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:51 2022] DELETE /identity/v3/users/cc1faa8297b64613be20bd51236f640d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:52.018040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:52.018528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:52.018701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:52.036206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:52.037486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:52.041504 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:52.098027 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1296/2564] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:52.107902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:52.109598 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:52.166239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d318d2-85bd-4585-b747-7c604ad730d2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:52.170621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:52.171311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:52.171595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:52.171853 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:52.182017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:52.183534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:52.194118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1269/2565] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:52.473031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:52.474678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:52.487201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20cade-2334-4c8c-ba88-288e77799615 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:52.492184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:52.493300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:52.493667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:52.494005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] PATH_INFO: `/v3/projects/10d103eb2f7c48f883c58b7303ba92a8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:52.495495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d103eb2f7c48f883c58b7303ba92a8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:52.500412 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:52.551897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d103eb2f7c48f883c58b7303ba92a8', 'request_id': 'req-df9f0301-988b-47cb-ab3e-9b5d7f19360c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.561064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d103eb2f7c48f883c58b7303ba92a8', 'request_id': 'req-df9f0301-988b-47cb-ab3e-9b5d7f19360c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.566773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d103eb2f7c48f883c58b7303ba92a8', 'request_id': 'req-df9f0301-988b-47cb-ab3e-9b5d7f19360c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.579275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] The token cache is being invalidate because project 10d103eb2f7c48f883c58b7303ba92a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:52.579620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.580332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.581969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1297/2566] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:52 2022] DELETE /identity/v3/projects/10d103eb2f7c48f883c58b7303ba92a8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:52.586194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:52.596186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a146dd-64cd-42ce-82ff-c188624a7ddd service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:52.661465 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:52.662634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:52.662954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:52.663229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] PATH_INFO: `/v3/users/c51fb90cdd8f4c81884f7e94bb2dae7e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:52.664518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51fb90cdd8f4c81884f7e94bb2dae7e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:52.666552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:52.668967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:52.717235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51fb90cdd8f4c81884f7e94bb2dae7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.729463 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51fb90cdd8f4c81884f7e94bb2dae7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.730127 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51fb90cdd8f4c81884f7e94bb2dae7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.737245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51fb90cdd8f4c81884f7e94bb2dae7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.737969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-14400503-9c2f-4f9a-ad46-d716ce59298a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51fb90cdd8f4c81884f7e94bb2dae7e'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:52.751702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1270/2567] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:52 2022] DELETE /identity/v3/users/c51fb90cdd8f4c81884f7e94bb2dae7e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:53.041324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.042831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:53.056111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f0301-988b-47cb-ab3e-9b5d7f19360c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.112589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.113514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.113794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.114070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] PATH_INFO: `/v3/projects/c10e5337a59f4c109f87507ecadcd355` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.115452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10e5337a59f4c109f87507ecadcd355)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.117411 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.157375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:53.168296 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10e5337a59f4c109f87507ecadcd355', 'request_id': 'req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:53.175883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10e5337a59f4c109f87507ecadcd355', 'request_id': 'req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:53.182763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10e5337a59f4c109f87507ecadcd355', 'request_id': 'req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:53.194269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] The token cache is being invalidate because project c10e5337a59f4c109f87507ecadcd355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:53.194552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:53.195269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eda22a26-93c5-40f6-b122-5bf27ab4bcdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:53.196879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1298/2568] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:53 2022] DELETE /identity/v3/projects/c10e5337a59f4c109f87507ecadcd355 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:53.202034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.202536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.202650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.221526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:53.222823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:53.286282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1271/2569] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:53.294932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.295201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.295491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.314012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:53.315332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:53.323815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1299/2570] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:53.328041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.337641 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a098-14e0-4550-98bb-395c0eb9e30f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.342286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.342987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.343276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.343593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.344316 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:40:53.344623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.346289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.357976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1272/2571] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:40:53.362432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.371848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5e8d-48d2-4c95-a6c3-20e0c6582e2f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.376804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.377485 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.377771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.378047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.378742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.380691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.408725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1300/2572] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:53.413329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.423504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507da-fb35-4a7e-baf3-3214c4907152 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.483566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.484312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.484594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.484956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.485561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.487560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.505967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:53.516823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1273/2573] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:40:53.518472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.531120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f324d-ebac-4547-a063-6d864084e439 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.536423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.537591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.537786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.538064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.539259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.541026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.564003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.564430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1301/2574] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:40:53.569396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2682-8273-4f3d-9412-a419fdb7a744 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.574184 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.574901 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.575180 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.575454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.576215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.577788 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe5bb-05bf-468f-a7a7-9604275e33c7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.589753 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1274/2575] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:53.594102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.604265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1221-cec5-4812-bf6f-58b1978bcead admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.609672 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.610597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.610890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.611170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] PATH_INFO: `/v3/projects/83b3f711b8654b409cdd2b0999138a97/users/9c97b908bf444b02bd45f6a1f0260b00/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.625627 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b3f711b8654b409cdd2b0999138a97, user_id=9c97b908bf444b02bd45f6a1f0260b00, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.628328 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.642957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1302/2576] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:53 2022] PUT /identity/v3/projects/83b3f711b8654b409cdd2b0999138a97/users/9c97b908bf444b02bd45f6a1f0260b00/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:40:53.653682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.653986 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.654263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.682609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] MFA Rules not processed for user `9c97b908bf444b02bd45f6a1f0260b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:53.683881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:53.752846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1275/2577] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:53.757520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.823645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150d7a-e4c0-4d10-bd34-44e6e8f2f298 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.828794 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.829467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.829741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.829995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.830705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.832635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.860287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1303/2578] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:40:53.864443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.875837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceacef-b61e-4a89-8af4-2cb78eeed8ec None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.933512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.934192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.934498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.934771 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.935489 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.937434 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.962796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1276/2579] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:53 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:53.964110 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:53.974929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66904-880e-4908-b7e7-5b74f8ebff6c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:53.979918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:53.980579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:53.980856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:53.981134 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:53.981855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:53.983501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:53.994148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1304/2580] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:53.998214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:54.008457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f370d-0876-4a0f-b388-2b28590f8cef admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:54.013635 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:54.014498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.014824 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.015090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] PATH_INFO: `/v3/projects/44176bbc208d403ebc4587f1fa5a576a/users/2a1417f6bb3f4052972acaf268ede3eb/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.030242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44176bbc208d403ebc4587f1fa5a576a, user_id=2a1417f6bb3f4052972acaf268ede3eb, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:54.032931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:54.048870 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1277/2581] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:53 2022] PUT /identity/v3/projects/44176bbc208d403ebc4587f1fa5a576a/users/2a1417f6bb3f4052972acaf268ede3eb/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:54.053012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:54.063118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94907b-8d95-4118-877c-ffa757570830 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:54.093894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:54.122875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:54.123544 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.123833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.124104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.124831 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:54.126437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e920483-afd3-4505-9023-e9c1a0406480 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:54.136653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1305/2582] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:54.141152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:54.152421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529344d-bbee-4dfd-aec5-d2e57df334fd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:54.158304 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:54.159243 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.159523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.159799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] PATH_INFO: `/v3/projects/44176bbc208d403ebc4587f1fa5a576a/users/2a1417f6bb3f4052972acaf268ede3eb/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.162107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44176bbc208d403ebc4587f1fa5a576a, user_id=2a1417f6bb3f4052972acaf268ede3eb, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:54.164823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:54.177045 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1278/2583] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:54 2022] PUT /identity/v3/projects/44176bbc208d403ebc4587f1fa5a576a/users/2a1417f6bb3f4052972acaf268ede3eb/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:54.188455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.188734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.189008 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.218466 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] MFA Rules not processed for user `2a1417f6bb3f4052972acaf268ede3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:54.219741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:54.290263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1306/2584] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:54.302354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:54.304313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:54.337736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:54.364791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00273a0-27f8-412b-80be-0aeb62978f9d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:54.368817 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:54.369541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.369823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.370097 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.427506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:54.428956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:54.438110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1279/2585] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:54.683265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:54.684964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:54.700379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d29a56-e566-4c31-9c3e-9ba187a56f59 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:54.704177 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:54.704871 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:54.705154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:54.705430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:54.707415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:54.824888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:54.826314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:54.839433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1307/2586] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:55.826655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:55.836012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acadae-4190-48dc-a04f-d8364542c391 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:55.840535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:55.841185 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:55.841473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:55.841744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:55.851349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:55.852785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:55.862459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1280/2587] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:57.449551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:57.463600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3f11-2d50-48ee-8d71-e4132c71f5d6 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:57.468662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:57.469317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:57.469604 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:57.469875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:57.472117 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:57.487288 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:57.488724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14cf9b-f226-4cc9-836e-bacdb49c5431 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:57.502090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1308/2588] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:59.674482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:59.739108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29c96b-c9c2-415a-9a68-e46a6e9da01e service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:59.745510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:59.746406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:59.746684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:59.746987 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] PATH_INFO: `/v3/users/9c97b908bf444b02bd45f6a1f0260b00` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:59.748365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c97b908bf444b02bd45f6a1f0260b00)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:59.750317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:59.808195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c97b908bf444b02bd45f6a1f0260b00'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:59.821422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c97b908bf444b02bd45f6a1f0260b00'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:59.822487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c97b908bf444b02bd45f6a1f0260b00'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:59.827895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:59.829983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c97b908bf444b02bd45f6a1f0260b00'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:59.830664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c97b908bf444b02bd45f6a1f0260b00'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:59.850995 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1281/2589] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:59 2022] DELETE /identity/v3/users/9c97b908bf444b02bd45f6a1f0260b00 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:59.855236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:59.855694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:59.856143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:59.874403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:59.875717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:59.895773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:59.935960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1309/2590] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:59.946390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:59.947944 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:00.011357 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad976a5-d30d-45bd-bdbc-e5e325115b39 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:00.015122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:00.015859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:00.016141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:00.016436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:00.026069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:00.027549 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:00.037752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1282/2591] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:41:00.378971 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:00.380746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:00.393817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422fe65-396d-44de-9452-87e5497e9d16 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:00.399511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:00.400482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:00.400877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:00.401388 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] PATH_INFO: `/v3/projects/83b3f711b8654b409cdd2b0999138a97` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:00.402916 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b3f711b8654b409cdd2b0999138a97)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:00.404901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:00.458357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b3f711b8654b409cdd2b0999138a97', 'request_id': 'req-6a23238c-4122-4403-885f-2e60889bc24c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.467322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b3f711b8654b409cdd2b0999138a97', 'request_id': 'req-6a23238c-4122-4403-885f-2e60889bc24c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.473437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b3f711b8654b409cdd2b0999138a97', 'request_id': 'req-6a23238c-4122-4403-885f-2e60889bc24c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.484551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] The token cache is being invalidate because project 83b3f711b8654b409cdd2b0999138a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:00.484838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.485472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.487049 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1310/2592] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:00 2022] DELETE /identity/v3/projects/83b3f711b8654b409cdd2b0999138a97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:00.491092 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:00.500959 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8979-0f46-48bc-8b71-d221d0da838d service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:00.559397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:00.560336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:00.560617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:00.560890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] PATH_INFO: `/v3/users/2a1417f6bb3f4052972acaf268ede3eb` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:00.562135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1417f6bb3f4052972acaf268ede3eb)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:00.564162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:00.617719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1417f6bb3f4052972acaf268ede3eb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.630906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1417f6bb3f4052972acaf268ede3eb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.631615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1417f6bb3f4052972acaf268ede3eb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.639132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1417f6bb3f4052972acaf268ede3eb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.639806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-81375eb4-8520-4381-a43c-ee021bb3e869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1417f6bb3f4052972acaf268ede3eb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:00.653453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1283/2593] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:00 2022] DELETE /identity/v3/users/2a1417f6bb3f4052972acaf268ede3eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:00.933227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:00.934759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:00.949436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23238c-4122-4403-885f-2e60889bc24c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.011265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.012212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.012729 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.013155 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] PATH_INFO: `/v3/projects/44176bbc208d403ebc4587f1fa5a576a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.015087 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44176bbc208d403ebc4587f1fa5a576a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.017114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.071746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44176bbc208d403ebc4587f1fa5a576a', 'request_id': 'req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:01.074260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:01.081734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44176bbc208d403ebc4587f1fa5a576a', 'request_id': 'req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:01.087979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44176bbc208d403ebc4587f1fa5a576a', 'request_id': 'req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:01.100704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] The token cache is being invalidate because project 44176bbc208d403ebc4587f1fa5a576a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:01.100989 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:01.101680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec4ec1c7-2aa9-44d9-9643-bd011aa40a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:01.103300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1311/2594] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:00 2022] DELETE /identity/v3/projects/44176bbc208d403ebc4587f1fa5a576a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:01.108411 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.108905 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.109005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.127892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:01.129128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:01.135088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:01.196353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1284/2595] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:01.204398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.204695 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.205025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.225781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:01.227077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:01.235901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1312/2596] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:01.240469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.253319 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7705-6d5b-4e75-892b-34f0cf40195a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.258593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.259299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.259579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.259854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.260580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:01.260890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.262557 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.274594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1285/2597] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:01.279866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.288849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187423d-022c-4753-b317-5b041d3f4065 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.293902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.294572 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.294887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.295167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.295861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.297798 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.327044 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1313/2598] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:01.330551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.341207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31c93-8bd0-4b19-a134-ffc92b514d8c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.401681 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.402381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.402663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.402979 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.403680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.405624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.425882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1286/2599] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:41:01.430287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.441191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530141-fa3a-45db-b8d0-85352186716b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.447187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.447949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.448208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.448475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.449231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.450914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.461761 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1314/2600] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:01.465808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.476101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b041e-4426-4fb8-b1db-a19b61ac4a77 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.481405 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.482041 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.482365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.482636 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.483385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.484972 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e5290-87fc-439a-b2ba-db8e1374022d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.495039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1287/2601] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:01.499174 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.509089 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74d3c-998b-4728-af07-4daef55d6e30 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.514056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.514906 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.515184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.515454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] PATH_INFO: `/v3/projects/38a27bfaa8a24c738ddb6ee062bd60c5/users/864b6768781446dfb0850feb792e9bd8/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.529605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a27bfaa8a24c738ddb6ee062bd60c5, user_id=864b6768781446dfb0850feb792e9bd8, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.532274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.546070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1315/2602] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:01 2022] PUT /identity/v3/projects/38a27bfaa8a24c738ddb6ee062bd60c5/users/864b6768781446dfb0850feb792e9bd8/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:01.556277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.556564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.556834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.584368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] MFA Rules not processed for user `864b6768781446dfb0850feb792e9bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:01.585570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:01.654472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1288/2603] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:01.659363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.725176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b56aa-0c12-4e06-9579-66a64d07e44b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.730430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.731224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.731499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.731773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.732459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.734368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.763451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1316/2604] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:01.767885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.779450 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d137cb9-ca32-481d-bd67-c6f306507bee None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.783435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:01.840451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.841148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.841433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.841718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.842451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.844424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.866527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1289/2605] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:01 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:01.870811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.882014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39f2b-ebea-447a-8767-2e53b71ed558 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.887705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.888403 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.888687 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.888962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.889738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.891395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.901950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1317/2606] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:01.906242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.916322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b32508-68b6-48d9-a9e8-31183a9760e7 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:01.921144 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:01.922034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:01.922314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:01.922592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] PATH_INFO: `/v3/projects/85ff595e13ff453b8377fba657154d1e/users/d14725a5ef2544d4a66d8c34568a92ce/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:01.937564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ff595e13ff453b8377fba657154d1e, user_id=d14725a5ef2544d4a66d8c34568a92ce, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:01.940346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:01.955862 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1290/2607] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:01 2022] PUT /identity/v3/projects/85ff595e13ff453b8377fba657154d1e/users/d14725a5ef2544d4a66d8c34568a92ce/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:01.960495 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:01.972751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e505a5-bffd-40e6-a0a5-38088a54b3b9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:02.021622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:02.033073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:02.033925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.034261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.034958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.036093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:02.038763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693c58-e868-4d0c-a254-517045fb6d11 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:02.054673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1318/2608] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:02.060546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:02.072225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142f366-38a6-4859-ad56-80fc89a17e96 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:02.077338 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:02.078246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.078533 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.078839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] PATH_INFO: `/v3/projects/85ff595e13ff453b8377fba657154d1e/users/d14725a5ef2544d4a66d8c34568a92ce/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.080990 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ff595e13ff453b8377fba657154d1e, user_id=d14725a5ef2544d4a66d8c34568a92ce, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:02.083704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:02.094763 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1291/2609] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:02 2022] PUT /identity/v3/projects/85ff595e13ff453b8377fba657154d1e/users/d14725a5ef2544d4a66d8c34568a92ce/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:02.105901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.106303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.106587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.134938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] MFA Rules not processed for user `d14725a5ef2544d4a66d8c34568a92ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:02.136144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:02.205318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1319/2610] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:02.219234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:02.221955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:02.284106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9fbd-4a49-4bff-a1b7-86af8295a482 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:02.288126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:02.288790 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.289076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.289337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.298766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:02.300229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188690-77f8-48df-bc9f-6e8bb9236e91 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:02.309837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1292/2611] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:02.379062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:02.449952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607146f-d617-4ab4-8251-c0d9c3f8abf5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:02.455857 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:02.456736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.457012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.457320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] PATH_INFO: `/v3/users/864b6768781446dfb0850feb792e9bd8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.458503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864b6768781446dfb0850feb792e9bd8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:02.460498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:02.510157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864b6768781446dfb0850feb792e9bd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:02.523099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864b6768781446dfb0850feb792e9bd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:02.523814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864b6768781446dfb0850feb792e9bd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:02.530867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864b6768781446dfb0850feb792e9bd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:02.531540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864b6768781446dfb0850feb792e9bd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:02.533297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:02.547240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1320/2612] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:02 2022] DELETE /identity/v3/users/864b6768781446dfb0850feb792e9bd8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:02.551898 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.552188 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.552466 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.571721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:02.572966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:02.638027 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1293/2613] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:02.649277 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:02.650878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:02.723360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030db5-eead-4ee2-a896-b9f75693bc23 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:02.728301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:02.729052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:02.729436 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:02.729801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:02.741173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:02.742749 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:02.753423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1321/2614] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:03.043616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:03.045177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:03.055029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:03.064700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0d4a-2929-43f9-9e86-dfa273f20227 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:03.073899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:03.075000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:03.075297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:03.075575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] PATH_INFO: `/v3/projects/38a27bfaa8a24c738ddb6ee062bd60c5` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:03.076801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a27bfaa8a24c738ddb6ee062bd60c5)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:03.078947 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:03.136955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a27bfaa8a24c738ddb6ee062bd60c5', 'request_id': 'req-304fb0e3-0a88-4382-8904-40003e06e4d6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.145270 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a27bfaa8a24c738ddb6ee062bd60c5', 'request_id': 'req-304fb0e3-0a88-4382-8904-40003e06e4d6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.151810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a27bfaa8a24c738ddb6ee062bd60c5', 'request_id': 'req-304fb0e3-0a88-4382-8904-40003e06e4d6'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.162477 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] The token cache is being invalidate because project 38a27bfaa8a24c738ddb6ee062bd60c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:03.162760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.163426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.164991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1294/2615] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:03 2022] DELETE /identity/v3/projects/38a27bfaa8a24c738ddb6ee062bd60c5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:03.169135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:03.179226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12a874-e7f1-4951-aecc-16e60956e280 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:03.239849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:03.240739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:03.241013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:03.241283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] PATH_INFO: `/v3/users/d14725a5ef2544d4a66d8c34568a92ce` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:03.242464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14725a5ef2544d4a66d8c34568a92ce)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:03.245068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:03.295886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14725a5ef2544d4a66d8c34568a92ce'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.308035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14725a5ef2544d4a66d8c34568a92ce'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.308667 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14725a5ef2544d4a66d8c34568a92ce'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.316541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14725a5ef2544d4a66d8c34568a92ce'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.317216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-aba9fce9-6fed-40b0-943f-20bfe8d65ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14725a5ef2544d4a66d8c34568a92ce'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.331247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1322/2616] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:03 2022] DELETE /identity/v3/users/d14725a5ef2544d4a66d8c34568a92ce => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:03.656528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:03.658042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:03.672189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fb0e3-0a88-4382-8904-40003e06e4d6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:03.732002 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:03.732893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:03.733178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:03.733456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] PATH_INFO: `/v3/projects/85ff595e13ff453b8377fba657154d1e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:03.734659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ff595e13ff453b8377fba657154d1e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:03.736627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:03.787341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ff595e13ff453b8377fba657154d1e', 'request_id': 'req-af407cea-42a4-4f4a-b11d-9963bf4aff61'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.801273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ff595e13ff453b8377fba657154d1e', 'request_id': 'req-af407cea-42a4-4f4a-b11d-9963bf4aff61'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.808878 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ff595e13ff453b8377fba657154d1e', 'request_id': 'req-af407cea-42a4-4f4a-b11d-9963bf4aff61'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.820585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] The token cache is being invalidate because project 85ff595e13ff453b8377fba657154d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:03.820930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.833103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-af407cea-42a4-4f4a-b11d-9963bf4aff61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:03.839538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1295/2617] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:03 2022] DELETE /identity/v3/projects/85ff595e13ff453b8377fba657154d1e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:03.842399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:03.842768 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:03.843091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:03.863175 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:03.864398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:03.876465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:03.962763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1323/2618] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:03.970723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:03.971120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:03.971303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.001418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:04.002820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:04.012291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1296/2619] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:04.016998 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.027781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ebca6-7827-4a46-9033-2f15f46b83f3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.032624 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.033300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.033579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.033851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.034588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:04.034930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.036559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.049104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1324/2620] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:04.054392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.066014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b25aa-9341-458f-8a81-3ccabfa3f66d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.072695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.073332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.073588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.073865 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.074571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.076510 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.080908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:04.110107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1297/2621] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:04.114068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.126686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee141f-433e-41f1-8827-8e44c6596f48 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.186939 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.187628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.187911 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.188270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.188876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.190825 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.218077 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1325/2622] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:04.219410 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.230368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9431-0d74-4753-aa6c-8e8439577e9b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.235330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.236046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.236324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.236603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.237333 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.238998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.249877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1298/2623] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:04.254127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.264527 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741bca1-8d4b-4615-b2da-c3b9cb340576 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.269349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.270026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.270308 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.270581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.271349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.272955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aed9a7-d8ca-4b91-9ef0-9e658ca8e04a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.283888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1326/2624] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:04.288936 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.299723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944c52-879e-4019-8e9e-c40de29c2b02 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.304350 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.305258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.305538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.305814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] PATH_INFO: `/v3/projects/b78b0379434b4f31a591adea1fa51d1c/users/9d3bf65cbdab4b45834fcb919c34200c/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.321349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78b0379434b4f31a591adea1fa51d1c, user_id=9d3bf65cbdab4b45834fcb919c34200c, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.324137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.338101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1299/2625] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:04 2022] PUT /identity/v3/projects/b78b0379434b4f31a591adea1fa51d1c/users/9d3bf65cbdab4b45834fcb919c34200c/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:04.348674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.349011 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.349292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.377709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] MFA Rules not processed for user `9d3bf65cbdab4b45834fcb919c34200c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:04.379000 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:04.449359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1327/2626] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:04.453908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.522268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab8e68-9886-4904-b5c3-f44c231fa253 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.527352 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.528052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.528340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.528617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.529306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.531281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.558631 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1300/2627] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:04.562896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.574710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7f2d9-be86-454e-931f-34e14e33dceb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.579763 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:04.634801 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.635507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.635775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.636051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.636766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.638889 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.661700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1328/2628] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:04.665851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.676705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d43e3-0ce4-4c31-a359-10a1dc67e767 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.682007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.682700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.683021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.683296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.683998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.685767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.697358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1301/2629] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:04.701583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.712170 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03581-3c18-4ab0-8e66-7f859ea72c6e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.720720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.721992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.722286 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.722555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] PATH_INFO: `/v3/projects/fa69015c098d424188bea80475ecc921/users/0aeb008878354fc8aed6b8eac3e5fd9f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.741334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa69015c098d424188bea80475ecc921, user_id=0aeb008878354fc8aed6b8eac3e5fd9f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.744033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.758890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1329/2630] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:04 2022] PUT /identity/v3/projects/fa69015c098d424188bea80475ecc921/users/0aeb008878354fc8aed6b8eac3e5fd9f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:04.762956 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.772993 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea7ae-8618-4a65-a80c-607c9dbfed65 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.831912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.832519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.832800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.833074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.833804 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.835454 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebc4c1-61ae-4b70-8cdb-0161cdfa0c63 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.845432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1302/2631] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:41:04.849790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:04.860997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fff15-c42b-4c6b-b445-975539338c2b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:04.866396 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:04.867324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.867629 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.867899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] PATH_INFO: `/v3/projects/fa69015c098d424188bea80475ecc921/users/0aeb008878354fc8aed6b8eac3e5fd9f/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.869923 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa69015c098d424188bea80475ecc921, user_id=0aeb008878354fc8aed6b8eac3e5fd9f, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:04.872676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:04.883995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1330/2632] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:04 2022] PUT /identity/v3/projects/fa69015c098d424188bea80475ecc921/users/0aeb008878354fc8aed6b8eac3e5fd9f/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:04.957810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:04.958264 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:04.958749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:04.990233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] MFA Rules not processed for user `0aeb008878354fc8aed6b8eac3e5fd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:04.991518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:05.002204 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:05.065768 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1303/2633] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:05.077382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:05.079760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:05.140160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e2c2-46b5-4122-9c8f-f4cd5506ac8f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:05.144141 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:05.144835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:05.145125 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:05.145399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:05.154962 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:05.156455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:05.166548 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1331/2634] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:05.269457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:05.279158 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df79bd-e411-4337-a117-46ad59c710e0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:05.282708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:05.283470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:05.283815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:05.284219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:05.344037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:05.345496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bf302-c280-4930-bc58-0710d1fbdfc6 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:05.354764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1304/2635] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:07.944239 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:08.011098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a674b1-3d3c-4985-86ed-81fdffc12ad5 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:08.015985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:08.016865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:08.017146 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:08.017417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] PATH_INFO: `/v3/users/9d3bf65cbdab4b45834fcb919c34200c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:08.019062 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3bf65cbdab4b45834fcb919c34200c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:08.020994 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:08.025956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:08.072320 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3bf65cbdab4b45834fcb919c34200c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.085440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3bf65cbdab4b45834fcb919c34200c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.086151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3bf65cbdab4b45834fcb919c34200c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.094341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3bf65cbdab4b45834fcb919c34200c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.095050 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3bf65cbdab4b45834fcb919c34200c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.109236 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1332/2636] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:07 2022] DELETE /identity/v3/users/9d3bf65cbdab4b45834fcb919c34200c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:08.113789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:08.114320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:08.114563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:08.132760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:08.134133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:08.210159 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1305/2637] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:08.220240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:08.221992 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:08.283724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc917b-2b3c-421e-a69f-2f54963c04ac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:08.287452 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:08.288121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:08.288405 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:08.288680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:08.298067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:08.299575 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:08.309487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1333/2638] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:08.584688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:08.586237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:08.603176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35a35-582f-4b56-9439-bf30625e9951 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:08.611440 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:08.612512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:08.612837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:08.613149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] PATH_INFO: `/v3/projects/b78b0379434b4f31a591adea1fa51d1c` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:08.614365 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78b0379434b4f31a591adea1fa51d1c)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:08.616376 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:08.664413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:08.672122 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78b0379434b4f31a591adea1fa51d1c', 'request_id': 'req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.679811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78b0379434b4f31a591adea1fa51d1c', 'request_id': 'req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.686096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78b0379434b4f31a591adea1fa51d1c', 'request_id': 'req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.697200 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] The token cache is being invalidate because project b78b0379434b4f31a591adea1fa51d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:08.697482 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.698149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.699711 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1306/2639] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:08 2022] DELETE /identity/v3/projects/b78b0379434b4f31a591adea1fa51d1c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:08.704040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:08.714071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dcae-2774-4418-bc76-82bad20c646d service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:08.776140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:08.776955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:08.777243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:08.777521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] PATH_INFO: `/v3/users/0aeb008878354fc8aed6b8eac3e5fd9f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:08.778807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aeb008878354fc8aed6b8eac3e5fd9f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:08.780852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:08.811820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:08.831724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aeb008878354fc8aed6b8eac3e5fd9f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.843593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aeb008878354fc8aed6b8eac3e5fd9f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.844261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aeb008878354fc8aed6b8eac3e5fd9f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.851115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aeb008878354fc8aed6b8eac3e5fd9f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.851740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4055a093-c848-4594-b2aa-c348b3d092c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aeb008878354fc8aed6b8eac3e5fd9f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:08.866224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1334/2640] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:08 2022] DELETE /identity/v3/users/0aeb008878354fc8aed6b8eac3e5fd9f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:09.156038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.157566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.171648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d4646-7ce0-4b1f-ac0f-149fcb5140d0 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.243379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.244859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.245280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.245733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] PATH_INFO: `/v3/projects/fa69015c098d424188bea80475ecc921` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.247579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa69015c098d424188bea80475ecc921)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.250517 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.301962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa69015c098d424188bea80475ecc921', 'request_id': 'req-37dae499-66f6-4e84-8a85-dc73b300fa86'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:09.312197 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa69015c098d424188bea80475ecc921', 'request_id': 'req-37dae499-66f6-4e84-8a85-dc73b300fa86'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:09.321813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa69015c098d424188bea80475ecc921', 'request_id': 'req-37dae499-66f6-4e84-8a85-dc73b300fa86'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:09.333933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] The token cache is being invalidate because project fa69015c098d424188bea80475ecc921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:09.334036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:09.334723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:09.338012 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1307/2641] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:09 2022] DELETE /identity/v3/projects/fa69015c098d424188bea80475ecc921 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:09.343360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b09ba-1b5f-4a42-be29-119216f83d47 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.343835 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b09ba-1b5f-4a42-be29-119216f83d47 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.343958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b09ba-1b5f-4a42-be29-119216f83d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.363210 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bc9b09ba-1b5f-4a42-be29-119216f83d47 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:09.364446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bc9b09ba-1b5f-4a42-be29-119216f83d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.387814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.389378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.425653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1335/2642] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:09.433302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.433634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.433946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.449452 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dae499-66f6-4e84-8a85-dc73b300fa86 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.453332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.453985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:09.454100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.454247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.454544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.455254 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.456422 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.464167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1336/2643] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:09.468556 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.468846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.470312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.477775 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759243-0631-40ca-9520-1b6bac96772a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.480398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1308/2644] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:09.485445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.486115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.486399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.486684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.487458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:09.487766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.489424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.501374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1337/2645] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:41:09.505834 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.510746 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:09.516800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9288b-49b8-427d-9c29-1e9c3c53dd77 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.523380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.524096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.524716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.525218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.526119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.528310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.559034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1309/2646] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:09 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:09.561005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.572298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f12a3-b404-44bc-b47a-3f6bb0074181 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.634222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.634941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.635218 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.635474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.636164 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.638126 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.660207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1338/2647] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:09 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:09.664599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.676552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7a5d-a2f7-447e-b44a-394c6b9d5bae admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.681616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.682294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.682576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.682886 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.683624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.685238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.700016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1310/2648] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:09.701564 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.712721 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873c38-a6f4-4895-8d9c-5dfd61104816 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.717550 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.718290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.718698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.719013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.719792 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.721409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3676978-ae97-43b5-a959-19de670b32e3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.732460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1339/2649] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:09.736705 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.746630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb214ec-d75b-4fdd-ac98-05fcc7b4dca1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.752353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.753250 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.753526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.753798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] PATH_INFO: `/v3/projects/5e994070b7e24a62badb58c7c0a46b29/users/a331140719ef4e7289fcb01fdce909e6/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.769448 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e994070b7e24a62badb58c7c0a46b29, user_id=a331140719ef4e7289fcb01fdce909e6, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.772160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.791100 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1311/2650] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:09 2022] PUT /identity/v3/projects/5e994070b7e24a62badb58c7c0a46b29/users/a331140719ef4e7289fcb01fdce909e6/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:09.802031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.802352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.802625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.809757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:09.831958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] MFA Rules not processed for user `a331140719ef4e7289fcb01fdce909e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:09.833196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.899445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1340/2651] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:09.910893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:09.912743 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:09.972812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ad2a5-e3d2-44e9-a5c3-c22c28dcc100 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:09.976555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:09.977214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:09.977500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:09.977784 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:09.987154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:09.988659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:09.998065 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1312/2652] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:12.751055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:12.752514 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:12.823472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef94f-f2d3-40d8-86c1-65779e978881 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:12.827928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:12.828821 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:12.829105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:12.829373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] PATH_INFO: `/v3/users/c22bd4ec11c84c3c9f036664d992585d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:12.843668 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22bd4ec11c84c3c9f036664d992585d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:12.845708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:12.893227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22bd4ec11c84c3c9f036664d992585d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:12.905064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22bd4ec11c84c3c9f036664d992585d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:12.905737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22bd4ec11c84c3c9f036664d992585d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:12.912573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22bd4ec11c84c3c9f036664d992585d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:12.913263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-16b08f49-7864-4a7f-90ff-02fbcd65724a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22bd4ec11c84c3c9f036664d992585d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:12.928927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1341/2653] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:12 2022] DELETE /identity/v3/users/c22bd4ec11c84c3c9f036664d992585d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:13.106042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.117813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25daa-d1db-48b4-b8ec-45b8fd1353c0 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.184223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.185255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.185594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.185938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] PATH_INFO: `/v3/projects/fb700c18f005484db8a76313ed60bfae` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.199320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb700c18f005484db8a76313ed60bfae)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.201425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.246353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:13.253656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb700c18f005484db8a76313ed60bfae', 'request_id': 'req-e4f0c06b-2436-49f9-a79f-b5b478db20c2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:13.263282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb700c18f005484db8a76313ed60bfae', 'request_id': 'req-e4f0c06b-2436-49f9-a79f-b5b478db20c2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:13.271131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb700c18f005484db8a76313ed60bfae', 'request_id': 'req-e4f0c06b-2436-49f9-a79f-b5b478db20c2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:13.282467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] The token cache is being invalidate because project fb700c18f005484db8a76313ed60bfae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:13.282815 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:13.283572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-e4f0c06b-2436-49f9-a79f-b5b478db20c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:13.285311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1313/2654] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:13 2022] DELETE /identity/v3/projects/fb700c18f005484db8a76313ed60bfae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:13.290428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a152c-cb72-44a5-a854-40103534d560 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.290716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a152c-cb72-44a5-a854-40103534d560 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.291094 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a152c-cb72-44a5-a854-40103534d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.298282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:13.312213 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-194a152c-cb72-44a5-a854-40103534d560 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:13.313974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-194a152c-cb72-44a5-a854-40103534d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:13.375909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1342/2655] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:13.383999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.384284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.384558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.402370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:13.403530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:13.411341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1314/2656] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:13.415430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a152c-cb72-44a5-a854-40103534d560 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.425536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a152c-cb72-44a5-a854-40103534d560 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.430370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.431056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.431332 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.431637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.432357 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:13.432656 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.434248 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.446637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1343/2657] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:13.451231 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.461171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e0d85-eefa-4c57-86a6-ea214b121c08 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.466709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.467406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.467712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.468013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.468700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.470608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.503842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1315/2658] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:41:13.510450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.522766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1dd54-fd71-4df4-b9bd-c7e4460cdd1d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.582113 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.582795 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.583085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.583355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.584032 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.585945 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.608756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1344/2659] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:13.613292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.624052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e2648-73de-41b9-bfaf-65793959f269 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.628955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.629614 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.629892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.630165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.630927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.632560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.643178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1316/2660] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:13.647342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.657725 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300def0f-d3f8-4745-ae3f-70ffd0e9320c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.663104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.663777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.664066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.664347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.665214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.666890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df0cec-bcba-4d03-9d41-4aa1c1c4c74c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.677441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1345/2661] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:13.681812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.692403 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f79d0-d215-4cb0-a540-aea2b4576f9b admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.698683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.699604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.699881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.700153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] PATH_INFO: `/v3/projects/a4806cf974384cb7bb3e98341affcf4b/users/a57c161c201b4210b8a809210d707f28/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.716394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4806cf974384cb7bb3e98341affcf4b, user_id=a57c161c201b4210b8a809210d707f28, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.719233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.735340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1317/2662] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:13 2022] PUT /identity/v3/projects/a4806cf974384cb7bb3e98341affcf4b/users/a57c161c201b4210b8a809210d707f28/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:13.746473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.746766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.747083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.776799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] MFA Rules not processed for user `a57c161c201b4210b8a809210d707f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:13.778039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:13.850446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:13.860974 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.865345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1346/2663] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:13.929421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa046c-893d-4718-9f91-a8adee3bcb37 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:13.934383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:13.935133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:13.935396 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:13.935667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:13.936356 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:13.938383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:13.971267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1318/2664] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:13.972507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:13.983154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422b962-090e-4aaa-a551-f46bb3096187 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.039324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.040019 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.040306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.040582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.041276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.043299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.064888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1347/2665] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:13 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:14.069391 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:14.080281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d5dc6-4d5c-46ee-94fb-e8f8090045cc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.086170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.086897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.087176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.087444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.088168 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.089791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.102046 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1319/2666] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:14.106618 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:14.116870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f640e4-fe8d-4ffb-b58e-23b9e48d9c8a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.121810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.122697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.123006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.123276 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] PATH_INFO: `/v3/projects/7835b34838a74483833bd67526c4af46/users/4ea75a37212a4530bdcdea73c17126fb/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.138307 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7835b34838a74483833bd67526c4af46, user_id=4ea75a37212a4530bdcdea73c17126fb, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.141090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.156041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1348/2667] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:14 2022] PUT /identity/v3/projects/7835b34838a74483833bd67526c4af46/users/4ea75a37212a4530bdcdea73c17126fb/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:14.160028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:14.170112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af44a7-3eba-48b9-ab4d-a91912d6b5ae admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.207424 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:14.226178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.226859 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.227141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.227415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.228133 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.229736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb38bb-c45d-48b3-a768-772128c1f356 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.239351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1320/2668] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:14.243684 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:14.254817 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a136-b894-4066-a3a4-87958cf208ad admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.260118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.261005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.261282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.261559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] PATH_INFO: `/v3/projects/7835b34838a74483833bd67526c4af46/users/4ea75a37212a4530bdcdea73c17126fb/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.263646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7835b34838a74483833bd67526c4af46, user_id=4ea75a37212a4530bdcdea73c17126fb, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.266348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.276587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1349/2669] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:14 2022] PUT /identity/v3/projects/7835b34838a74483833bd67526c4af46/users/4ea75a37212a4530bdcdea73c17126fb/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:14.286716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.287053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.287354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.314306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] MFA Rules not processed for user `4ea75a37212a4530bdcdea73c17126fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:14.315540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:14.384807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1321/2670] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:14.395997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:14.398010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:14.459272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038c313-e0d3-4391-836d-c8b952b2b6b3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:14.463417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:14.464060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:14.464356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:14.464612 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:14.523185 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:14.524813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:14.537400 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1350/2671] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:17.111749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:17.122473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb08c-f4e7-4768-b828-5056d102377b None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:17.126559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:17.127246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:17.127563 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:17.127830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:17.137512 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:17.139007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba16ce3-f358-4447-afbb-36f6983f0a1a service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:17.148682 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1322/2672] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:24.530075 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:24.638070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:24.639736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:24.709374 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881c99-e0fe-4f39-83fb-d37cf5ea340e service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:24.714312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:24.715234 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:24.715515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:24.715790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] PATH_INFO: `/v3/users/a331140719ef4e7289fcb01fdce909e6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:24.717015 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a331140719ef4e7289fcb01fdce909e6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:24.718966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:24.769456 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a331140719ef4e7289fcb01fdce909e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:24.790605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a331140719ef4e7289fcb01fdce909e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:24.791422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a331140719ef4e7289fcb01fdce909e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:24.804457 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a331140719ef4e7289fcb01fdce909e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:24.805275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a331140719ef4e7289fcb01fdce909e6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:24.818417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1351/2673] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:24 2022] DELETE /identity/v3/users/a331140719ef4e7289fcb01fdce909e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:24.823660 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:24.824106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:24.824345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:24.843055 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:24.844276 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:24.908091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1323/2674] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:24.918148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:24.919594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:24.983187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287521-20b2-48bb-b2e3-29824af012e0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:24.987820 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:24.988470 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:24.988760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:24.989039 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:24.999673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:25.001138 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:25.011362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1352/2675] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:25.292349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:25.293994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:25.307638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a3ac-7c30-4709-a82f-e4ecb14130d4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:25.313148 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:25.314498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:25.314806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:25.315099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] PATH_INFO: `/v3/projects/5e994070b7e24a62badb58c7c0a46b29` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:25.316393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e994070b7e24a62badb58c7c0a46b29)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:25.318397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:25.363948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:25.368426 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e994070b7e24a62badb58c7c0a46b29', 'request_id': 'req-0fa1387d-18d0-4d70-ba28-784dc77712fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:25.377014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e994070b7e24a62badb58c7c0a46b29', 'request_id': 'req-0fa1387d-18d0-4d70-ba28-784dc77712fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:25.383532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e994070b7e24a62badb58c7c0a46b29', 'request_id': 'req-0fa1387d-18d0-4d70-ba28-784dc77712fc'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:25.395973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] The token cache is being invalidate because project 5e994070b7e24a62badb58c7c0a46b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:25.396265 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:25.396994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-0fa1387d-18d0-4d70-ba28-784dc77712fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:25.399689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1324/2676] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:25 2022] DELETE /identity/v3/projects/5e994070b7e24a62badb58c7c0a46b29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:29.744052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:29.745713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:29.759034 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c751-7d59-49c3-a942-1b5dbbb2cd12 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:29.779933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:29.825409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:29.826311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:29.826592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:29.826914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] PATH_INFO: `/v3/users/a57c161c201b4210b8a809210d707f28` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:29.828284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57c161c201b4210b8a809210d707f28)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:29.830231 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:29.885652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57c161c201b4210b8a809210d707f28'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:29.897524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57c161c201b4210b8a809210d707f28'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:29.898206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57c161c201b4210b8a809210d707f28'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:29.905289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57c161c201b4210b8a809210d707f28'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:29.905977 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57c161c201b4210b8a809210d707f28'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:29.921428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1353/2677] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:29 2022] DELETE /identity/v3/users/a57c161c201b4210b8a809210d707f28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:29.926171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:29.926701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:29.926701 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:29.945797 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:29.947040 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:30.008842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1325/2678] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:30.018851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:30.020528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:30.081759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d4ce-ce9a-4ad6-9fcd-c7943399df9b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:30.086017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:30.086638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:30.086958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:30.087229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:30.096636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:30.098081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:30.107557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1354/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:30.388000 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:30.389616 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:30.401638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd5b73-6daa-4d19-a29e-57c3ece6069f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:30.406419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:30.407340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:30.407640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:30.407914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] PATH_INFO: `/v3/projects/a4806cf974384cb7bb3e98341affcf4b` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:30.409114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4806cf974384cb7bb3e98341affcf4b)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:30.411093 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:30.462080 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4806cf974384cb7bb3e98341affcf4b', 'request_id': 'req-dd79d376-06a9-43bd-977b-a0664d6360e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.470321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4806cf974384cb7bb3e98341affcf4b', 'request_id': 'req-dd79d376-06a9-43bd-977b-a0664d6360e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.476749 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4806cf974384cb7bb3e98341affcf4b', 'request_id': 'req-dd79d376-06a9-43bd-977b-a0664d6360e3'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.487171 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] The token cache is being invalidate because project a4806cf974384cb7bb3e98341affcf4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:30.487462 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.488094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.489667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1326/2680] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:30 2022] DELETE /identity/v3/projects/a4806cf974384cb7bb3e98341affcf4b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:30.493827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:30.503722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe74-e83d-4fb7-b02e-a6ae3e4746f3 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:30.546628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:30.565242 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:30.566156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:30.566444 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:30.566734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] PATH_INFO: `/v3/users/4ea75a37212a4530bdcdea73c17126fb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:30.568006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea75a37212a4530bdcdea73c17126fb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:30.570290 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:30.620832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea75a37212a4530bdcdea73c17126fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.632947 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea75a37212a4530bdcdea73c17126fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.633653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea75a37212a4530bdcdea73c17126fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.640598 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea75a37212a4530bdcdea73c17126fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.641220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9dad4f1-56e7-4f60-99cc-69b4bcc2dc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea75a37212a4530bdcdea73c17126fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:30.654565 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1355/2681] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:30 2022] DELETE /identity/v3/users/4ea75a37212a4530bdcdea73c17126fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:30.937593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:30.939143 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:30.956846 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d376-06a9-43bd-977b-a0664d6360e3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.010889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:31.018885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.019787 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.020459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.020759 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] PATH_INFO: `/v3/projects/7835b34838a74483833bd67526c4af46` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.021998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7835b34838a74483833bd67526c4af46)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.024569 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.072056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7835b34838a74483833bd67526c4af46', 'request_id': 'req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:31.080663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7835b34838a74483833bd67526c4af46', 'request_id': 'req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:31.086976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7835b34838a74483833bd67526c4af46', 'request_id': 'req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:31.099070 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] The token cache is being invalidate because project 7835b34838a74483833bd67526c4af46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:31.099364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:31.100686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9ce8f291-75c2-4532-aa9b-08bd2ac112d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:31.102473 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1327/2682] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:30 2022] DELETE /identity/v3/projects/7835b34838a74483833bd67526c4af46 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:31.107832 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.108329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.108435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.127973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:31.129176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:31.191428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1356/2683] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:31.202562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.202897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.203173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.223880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:31.225112 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:31.233406 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1328/2684] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:31.237854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.248383 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ece04-a092-40ad-ab94-de60a1401c9b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.253267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.253921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.254200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.254472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.255349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:31.255691 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.257287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.269498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1357/2685] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:31.273692 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.283207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45b3bf-ff1e-4a75-82e5-e0f2acc705c3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.287868 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.288525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.288814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.289094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.289799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.291800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.320173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1329/2686] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:31.324646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.335064 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5385-8dc2-462e-93fd-381dc404be39 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.383303 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:31.397156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.398178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.398814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.399214 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.400464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.403615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.428486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1358/2687] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:31.432718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.443820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bcc97-835b-45b9-9f94-706b508f5ec3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.450539 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.451207 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.451484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.451754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.452479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.454075 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.464688 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1330/2688] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:31.468678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.480337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e710c-9ff7-46f2-8392-dc4157469c1c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.486492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.487206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.487486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.487759 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.488518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.490121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a0819-cddd-41af-b00f-ec0c53af0c87 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.500834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1359/2689] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:41:31.507001 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.522606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971bcc-79da-4edd-917d-1b33d48d877e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.529345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.530223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.530502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.530772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] PATH_INFO: `/v3/projects/760ba624fdcc458891cf3beee4d29c02/users/c455be0164e44f8b860721399c79a231/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.546430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=760ba624fdcc458891cf3beee4d29c02, user_id=c455be0164e44f8b860721399c79a231, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.549110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.563887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1331/2690] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:31 2022] PUT /identity/v3/projects/760ba624fdcc458891cf3beee4d29c02/users/c455be0164e44f8b860721399c79a231/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:31.575085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db3a6-c364-4750-901a-54282621008b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.575373 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db3a6-c364-4750-901a-54282621008b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.575647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db3a6-c364-4750-901a-54282621008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.603752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-437db3a6-c364-4750-901a-54282621008b None None] MFA Rules not processed for user `c455be0164e44f8b860721399c79a231`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:31.605063 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-437db3a6-c364-4750-901a-54282621008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:31.673843 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1360/2691] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:31.678594 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.743968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ef4a-d94a-4673-a8dc-709c15ef4bbd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.749173 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.749839 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.750121 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.750399 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.751126 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.753050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.781219 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1332/2692] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:31.785520 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437db3a6-c364-4750-901a-54282621008b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.797199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437db3a6-c364-4750-901a-54282621008b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.856929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.857662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.857949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.858224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.858942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.860932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.882005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1361/2693] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:31 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:31.886332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.896755 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405f71-e1e9-43bd-a565-2604e793a9d3 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.901640 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.902303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.902591 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.902909 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.903664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.905279 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.906499 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:31.917792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1333/2694] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:31.921559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.931722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dafe6e-c988-4627-a933-95dbafef3d05 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.936577 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.937245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.937531 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.937808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.938546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.940194 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29ec54-ff8e-431c-b683-a257c1386e43 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:31.950976 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1362/2695] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:31.955116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:31.965215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaf5c4-23df-4eae-b1f4-58350ca18b9f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:31.970172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:31.971082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:31.971363 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:31.971632 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] PATH_INFO: `/v3/projects/d774a3d2d4d6489da2e8152b7fd9e08c/users/068cee276a12461a99a454bec2cb1cce/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:31.989062 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d774a3d2d4d6489da2e8152b7fd9e08c, user_id=068cee276a12461a99a454bec2cb1cce, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:31.991778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.009854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1334/2696] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:31 2022] PUT /identity/v3/projects/d774a3d2d4d6489da2e8152b7fd9e08c/users/068cee276a12461a99a454bec2cb1cce/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:32.024743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.025054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.025426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.052105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] MFA Rules not processed for user `068cee276a12461a99a454bec2cb1cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:32.053259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:32.079837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:32.120517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1363/2697] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:32.125194 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.188387 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fcc58-9aa2-48d4-96b1-0ccbd7226b8f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.194483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.195175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.195453 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.195726 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.196400 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.198389 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.225162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1335/2698] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:32 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:41:32.229397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.240088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a6d69-ab76-43af-8877-0c51ad21c79a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.310766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.311417 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.311698 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.311969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.312702 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.314694 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.340770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1364/2699] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:32 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:32.345111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.355890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7635-c1a4-4a37-91ec-2ad71094c52e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.360791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.361456 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.361740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.362018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.362752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.364432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.375383 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1336/2700] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:32.379571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.390325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5249-6590-4b98-b2c5-07c7de0cd1f1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.396202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.397124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.397389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.397662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] PATH_INFO: `/v3/projects/02836048a0e846c3b9992f07cdd30cab/users/4066289ab5e7477e9755e7d7234dfe08/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.413362 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02836048a0e846c3b9992f07cdd30cab, user_id=4066289ab5e7477e9755e7d7234dfe08, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.416533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.431345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1365/2701] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:32 2022] PUT /identity/v3/projects/02836048a0e846c3b9992f07cdd30cab/users/4066289ab5e7477e9755e7d7234dfe08/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:32.435540 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.446169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cda4d-d850-4f8e-89e0-a9a8b4951b34 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.507278 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.507938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.508222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.508497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.509216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.510825 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9e661-083e-494b-9dad-575314261684 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.520555 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1337/2702] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:32.525592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.536518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456135-aa7b-4fe4-ad87-a8be91597d8a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.542339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.543289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.543573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.543849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] PATH_INFO: `/v3/projects/02836048a0e846c3b9992f07cdd30cab/users/4066289ab5e7477e9755e7d7234dfe08/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.546135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02836048a0e846c3b9992f07cdd30cab, user_id=4066289ab5e7477e9755e7d7234dfe08, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.548833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.560722 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1366/2703] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:32 2022] PUT /identity/v3/projects/02836048a0e846c3b9992f07cdd30cab/users/4066289ab5e7477e9755e7d7234dfe08/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:32.572341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.572575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.572851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.601643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] MFA Rules not processed for user `4066289ab5e7477e9755e7d7234dfe08`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:32.602912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:32.637172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:32.684176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1338/2704] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:32.698284 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:32.700245 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:32.761122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd88a6-c517-44b5-9266-3b947d07d134 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:32.765241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:32.765896 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:32.766180 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:32.766455 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:32.775669 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:32.777116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:32.787232 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1367/2705] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:33.334379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:33.336059 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:33.349648 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b938a-f6be-4a68-9962-fb785cf0d628 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:33.354384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:33.355073 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:33.355351 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:33.355622 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:33.415700 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:33.417195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:33.426047 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1339/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:37.638345 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:37.649892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4472-18c3-42ef-aa04-87ed98dc312e service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:37.656868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:37.657657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:37.658002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:37.658341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:37.680818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:37.723279 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:37.724769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501177a0-2cdc-4220-8b65-3c8216576b76 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:37.734225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1368/2707] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:39.983975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:40.048408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937520e-f93f-4c72-9e66-83c8f2872ff4 service cinder] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:40.053554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:40.054435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:40.054723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:40.055019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] PATH_INFO: `/v3/users/c455be0164e44f8b860721399c79a231` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:40.056337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c455be0164e44f8b860721399c79a231)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:40.058283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:40.107317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c455be0164e44f8b860721399c79a231'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.119201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c455be0164e44f8b860721399c79a231'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.119996 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c455be0164e44f8b860721399c79a231'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.122237 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:40.129573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c455be0164e44f8b860721399c79a231'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.130244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c455be0164e44f8b860721399c79a231'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.144975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1340/2708] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:39 2022] DELETE /identity/v3/users/c455be0164e44f8b860721399c79a231 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:40.149793 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:40.150252 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:40.150385 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:40.167915 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:40.169128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:40.231523 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1369/2709] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:40.241427 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:40.243051 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:40.302326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24943-4574-46b3-858b-379ad2ce2a86 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:40.307154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:40.307810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:40.308099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:40.308379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:40.319036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:40.320857 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:40.331302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1341/2710] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:40.611743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:40.613351 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:40.625899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb78dc7-8347-40c0-a724-cf763c3fe9d5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:40.631899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:40.632955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:40.633266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:40.633592 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] PATH_INFO: `/v3/projects/760ba624fdcc458891cf3beee4d29c02` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:40.634878 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760ba624fdcc458891cf3beee4d29c02)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:40.636828 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:40.690156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760ba624fdcc458891cf3beee4d29c02', 'request_id': 'req-ab804a23-56d7-47bf-a2ca-91c035c7c030'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.698639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760ba624fdcc458891cf3beee4d29c02', 'request_id': 'req-ab804a23-56d7-47bf-a2ca-91c035c7c030'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.704304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760ba624fdcc458891cf3beee4d29c02', 'request_id': 'req-ab804a23-56d7-47bf-a2ca-91c035c7c030'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.715453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] The token cache is being invalidate because project 760ba624fdcc458891cf3beee4d29c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:40.715714 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.716390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.717982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1370/2711] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:40 2022] DELETE /identity/v3/projects/760ba624fdcc458891cf3beee4d29c02 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:40.722117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:40.732581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8af875-f785-4c6b-bd28-776882e2bc53 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:40.803072 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:40.803970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:40.804244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:40.804518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] PATH_INFO: `/v3/users/068cee276a12461a99a454bec2cb1cce` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:40.805738 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068cee276a12461a99a454bec2cb1cce)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:40.807747 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:40.861651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068cee276a12461a99a454bec2cb1cce'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.873345 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068cee276a12461a99a454bec2cb1cce'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.874019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068cee276a12461a99a454bec2cb1cce'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.880908 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068cee276a12461a99a454bec2cb1cce'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.881548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068cee276a12461a99a454bec2cb1cce'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:40.896491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1342/2712] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:40 2022] DELETE /identity/v3/users/068cee276a12461a99a454bec2cb1cce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:41.193583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:41.195651 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:41.209201 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a23-56d7-47bf-a2ca-91c035c7c030 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:41.253935 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:41.269863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:41.270745 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:41.271123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:41.271397 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] PATH_INFO: `/v3/projects/d774a3d2d4d6489da2e8152b7fd9e08c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:41.272582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d774a3d2d4d6489da2e8152b7fd9e08c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:41.274585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:41.324503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd774a3d2d4d6489da2e8152b7fd9e08c', 'request_id': 'req-711ce899-55d1-4a16-8b57-fd5e11feb349'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.335143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd774a3d2d4d6489da2e8152b7fd9e08c', 'request_id': 'req-711ce899-55d1-4a16-8b57-fd5e11feb349'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.341799 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd774a3d2d4d6489da2e8152b7fd9e08c', 'request_id': 'req-711ce899-55d1-4a16-8b57-fd5e11feb349'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.353957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] The token cache is being invalidate because project d774a3d2d4d6489da2e8152b7fd9e08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:41.354224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.354959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.356652 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1371/2713] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:41 2022] DELETE /identity/v3/projects/d774a3d2d4d6489da2e8152b7fd9e08c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:41.360889 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:41.362481 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:41.376164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17e6c-fec1-40cb-af65-366b91bb6283 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:41.380301 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:41.439052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:41.439943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:41.440216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:41.440491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] PATH_INFO: `/v3/users/4066289ab5e7477e9755e7d7234dfe08` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:41.441708 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4066289ab5e7477e9755e7d7234dfe08)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:41.443670 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:41.493366 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4066289ab5e7477e9755e7d7234dfe08'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.505999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4066289ab5e7477e9755e7d7234dfe08'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.506756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4066289ab5e7477e9755e7d7234dfe08'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.514808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4066289ab5e7477e9755e7d7234dfe08'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.515556 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a367d990-38f6-4d2a-aa8c-5b7eb9e08d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4066289ab5e7477e9755e7d7234dfe08'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.531288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1343/2714] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:41 2022] DELETE /identity/v3/users/4066289ab5e7477e9755e7d7234dfe08 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:41.831381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:41.832925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:41.846250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce899-55d1-4a16-8b57-fd5e11feb349 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:41.907844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:41.908643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:41.908929 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:41.909217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] PATH_INFO: `/v3/projects/02836048a0e846c3b9992f07cdd30cab` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:41.910517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02836048a0e846c3b9992f07cdd30cab)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:41.912484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:41.960269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02836048a0e846c3b9992f07cdd30cab', 'request_id': 'req-10ec5605-fde8-4919-8004-b1285854f4b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.968422 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02836048a0e846c3b9992f07cdd30cab', 'request_id': 'req-10ec5605-fde8-4919-8004-b1285854f4b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.974340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02836048a0e846c3b9992f07cdd30cab', 'request_id': 'req-10ec5605-fde8-4919-8004-b1285854f4b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.985760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] The token cache is being invalidate because project 02836048a0e846c3b9992f07cdd30cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:41.986047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.986827 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-10ec5605-fde8-4919-8004-b1285854f4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:41.988471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1372/2715] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:41 2022] DELETE /identity/v3/projects/02836048a0e846c3b9992f07cdd30cab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:41.994745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:41.995054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:41.995342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.014854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:42.016135 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:42.075998 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1344/2716] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:42.084813 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.085099 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.085366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.093121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:42.105593 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:42.107026 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:42.114984 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1373/2717] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:42.119269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.129166 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321816-bfc1-46c1-abc2-5638b3060688 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.134258 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.135015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.135294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.135566 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.136281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:42.136589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.138181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.149818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1345/2718] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:42.154227 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.164104 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78847-df6e-45cf-a199-08d2ee18f923 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.169673 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.170335 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.170617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.170932 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.171623 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.173539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.203287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1374/2719] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:42.209089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.220089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551aa0-1a10-4e64-ad50-93b00510b788 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.230252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:42.283039 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.283729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.284013 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.284289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.285008 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.287020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.309791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1346/2720] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:42.314364 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.325659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3fdd9-08a1-49a9-ad0f-917d2df0a8d7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.331433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.332096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.332371 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.332636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.333429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.335051 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.346560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1375/2721] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:41:42.350744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.361392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd17de-f7a3-49da-8999-51ba0a2dc139 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.366926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.367596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.367880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.368151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.368883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.370480 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adcb66-86eb-47ed-b8dd-bbfe0c4e9754 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.381014 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1347/2722] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:42.385263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.395615 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75f99-521a-4ea0-8b9a-d1cfce832641 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.400680 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.401573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.401855 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.402095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] PATH_INFO: `/v3/projects/d782fe7417f94942b7314f63fdbdb2a2/users/771a5658402d40f2baa9b8e683cec70a/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.417390 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d782fe7417f94942b7314f63fdbdb2a2, user_id=771a5658402d40f2baa9b8e683cec70a, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.420010 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.439803 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1376/2723] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:42 2022] PUT /identity/v3/projects/d782fe7417f94942b7314f63fdbdb2a2/users/771a5658402d40f2baa9b8e683cec70a/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:42.454397 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.454695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.455006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.485809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] MFA Rules not processed for user `771a5658402d40f2baa9b8e683cec70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:42.487719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:42.583627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1348/2724] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:42.589137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.661588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9e265-8512-47ff-9c41-bb15765687bc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.669622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.670497 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.670950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.671309 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.672376 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.675394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.710807 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1377/2725] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:42.715324 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.726550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583c88-09e6-45e5-8f68-2e56896656d1 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.786829 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.787522 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.787808 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.788083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.788845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.790801 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.814623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1349/2726] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:42 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:42.818708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.830193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc21695-e033-48d5-9146-d6c57677f26c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.835083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.835756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.836042 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.836316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.837052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.838703 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.849532 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1378/2727] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:42.853967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.864740 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c92e9-e3a5-4a12-9c2c-face80407da5 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.870286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.871286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.871567 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.871842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] PATH_INFO: `/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7/users/b17d43cdef6143aab6798464a1684b08/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.880980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:42.889170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9a0e2a4ca744b1a3e1c09465e52de7, user_id=b17d43cdef6143aab6798464a1684b08, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.893606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:42.914217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1350/2728] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:42 2022] PUT /identity/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7/users/b17d43cdef6143aab6798464a1684b08/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:42.919446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:42.929988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709634d-d5ff-41b3-899c-61f28baafe71 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:42.989643 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:42.990315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:42.990597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:42.990902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:42.991765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:42.993378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c069b5-df82-4f8a-ab83-1eadfa46c58a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:43.008791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1379/2729] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:43.013234 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:43.024170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901811d-db07-4def-b215-faa3b1b6dc74 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:43.030164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:43.031111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:43.031390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:43.031664 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] PATH_INFO: `/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7/users/b17d43cdef6143aab6798464a1684b08/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:43.034018 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9a0e2a4ca744b1a3e1c09465e52de7, user_id=b17d43cdef6143aab6798464a1684b08, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:43.036744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:43.047052 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1351/2730] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:43 2022] PUT /identity/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7/users/b17d43cdef6143aab6798464a1684b08/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:43.057368 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:43.057661 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:43.057943 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:43.077463 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:43.085545 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] MFA Rules not processed for user `b17d43cdef6143aab6798464a1684b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:43.087217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:43.156586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1380/2731] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:43.168082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:43.170110 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:43.237430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c82a-3375-4752-9b03-d07ab80bfce7 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:43.241228 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:43.241951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:43.242239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:43.242521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:43.298757 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:43.300236 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269711b8-f332-4161-8ec4-451adfae301c service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:43.309973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1352/2732] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:45.885324 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:45.951980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d300-ab89-4879-abce-55fada9c87c8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:45.957716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:45.958634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:45.958924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:45.959206 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] PATH_INFO: `/v3/users/771a5658402d40f2baa9b8e683cec70a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:45.960540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771a5658402d40f2baa9b8e683cec70a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:45.962490 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:46.012949 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771a5658402d40f2baa9b8e683cec70a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.024774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771a5658402d40f2baa9b8e683cec70a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.025418 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771a5658402d40f2baa9b8e683cec70a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.032281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771a5658402d40f2baa9b8e683cec70a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.032951 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771a5658402d40f2baa9b8e683cec70a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.048846 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1381/2733] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:45 2022] DELETE /identity/v3/users/771a5658402d40f2baa9b8e683cec70a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:46.054596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:46.055138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:46.055308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:46.078107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:46.079368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:46.141116 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1353/2734] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:46.151251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:46.152697 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:46.171633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:46.213686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd1939-caaf-46af-9439-148bfeee61c6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:46.217879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:46.218541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:46.218863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:46.219147 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:46.228851 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:46.230291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:46.240317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1382/2735] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:46.536113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:46.537599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:46.555963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0942-bf5d-4ba3-ad70-6fa661c828b4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:46.562420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:46.563378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:46.563655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:46.563931 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] PATH_INFO: `/v3/projects/d782fe7417f94942b7314f63fdbdb2a2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:46.565221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d782fe7417f94942b7314f63fdbdb2a2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:46.567272 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:46.596792 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:46.621005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd782fe7417f94942b7314f63fdbdb2a2', 'request_id': 'req-fdba21c5-f20c-4040-b6cf-90c092f4c04f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.629172 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd782fe7417f94942b7314f63fdbdb2a2', 'request_id': 'req-fdba21c5-f20c-4040-b6cf-90c092f4c04f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.635805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd782fe7417f94942b7314f63fdbdb2a2', 'request_id': 'req-fdba21c5-f20c-4040-b6cf-90c092f4c04f'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.648009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] The token cache is being invalidate because project d782fe7417f94942b7314f63fdbdb2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:46.648291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.648940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.650504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1354/2736] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:46 2022] DELETE /identity/v3/projects/d782fe7417f94942b7314f63fdbdb2a2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:46.654660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:46.664437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364762c4-3f34-4aeb-a88f-29e87673215d service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:46.723045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:46.723924 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:46.724207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:46.724484 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] PATH_INFO: `/v3/users/b17d43cdef6143aab6798464a1684b08` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:46.725833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17d43cdef6143aab6798464a1684b08)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:46.728035 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:46.777347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17d43cdef6143aab6798464a1684b08'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.789625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17d43cdef6143aab6798464a1684b08'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.790250 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17d43cdef6143aab6798464a1684b08'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.802297 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17d43cdef6143aab6798464a1684b08'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.803065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8d8d6b8f-9758-4a60-845a-e5cbe8fee898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17d43cdef6143aab6798464a1684b08'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:46.818516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1383/2737] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:46 2022] DELETE /identity/v3/users/b17d43cdef6143aab6798464a1684b08 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:47.306227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.307805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:47.323589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba21c5-f20c-4040-b6cf-90c092f4c04f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.388191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.389104 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.389393 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.389665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] PATH_INFO: `/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.390915 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9a0e2a4ca744b1a3e1c09465e52de7)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.392837 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.441369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9a0e2a4ca744b1a3e1c09465e52de7', 'request_id': 'req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:47.450418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9a0e2a4ca744b1a3e1c09465e52de7', 'request_id': 'req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:47.457245 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9a0e2a4ca744b1a3e1c09465e52de7', 'request_id': 'req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:47.468715 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] The token cache is being invalidate because project 2c9a0e2a4ca744b1a3e1c09465e52de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:47.469011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:47.469750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-6d16a5c4-5534-4d6d-bc31-6c06f07e8439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:47.471506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1355/2738] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:47 2022] DELETE /identity/v3/projects/2c9a0e2a4ca744b1a3e1c09465e52de7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:47.477826 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.478347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.478347 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.496480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:47.497710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:47.532392 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:47.567281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1384/2739] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:47.575584 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.575871 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.576147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.594856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:47.596108 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:47.604367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1356/2740] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:47.608886 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.618741 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835ef0-0908-4119-8fb6-b0a7addf6fed None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.623542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.624198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.624481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.624757 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.625501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:47.625815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.627478 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.639505 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1385/2741] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:47.644723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.655222 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801a740-7778-43a8-b543-8b8448d6615e None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.660329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.661105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.661388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.661661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.662360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.664385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.691290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1357/2742] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:47 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:47.695983 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.706093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf767e8-207f-4264-99cd-862e2e3fcf2e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.768810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.769579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.770018 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.770312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.771029 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.772997 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.799639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1386/2743] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:47 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:47.801017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.813284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cf8f-7965-4586-9918-499db4aa8f8e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.814829 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.815818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:47.821054 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.822033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.822680 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.823256 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.825176 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.827257 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.840057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1358/2744] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:47.844142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.850303 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:47.857677 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba81c-817f-43b9-88c6-5194e972ae09 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.864028 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.865023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.865798 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.866280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.867590 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.870491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.885659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1359/2745] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:47.890201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:47.909441 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fccf9-56df-4fd7-8944-b6c1191b82ea admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.915133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71bbe9-7211-4163-bd44-3aa11d6c80a8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:47.915754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.917053 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.917343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.917625 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] PATH_INFO: `/v3/projects/c8ffe493db56482f8f3f0e45d6247449/users/a842c33752174157817dec4fc695592d/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.925662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:47.926540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.926956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.927329 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:47.937663 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:47.938827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ffe493db56482f8f3f0e45d6247449, user_id=a842c33752174157817dec4fc695592d, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.942037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97400-f37f-4b74-bc77-7fbbb5918179 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.954003 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:47.955905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:47.969541 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1387/2746] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:47.982021 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1360/2747] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:47 2022] PUT /identity/v3/projects/c8ffe493db56482f8f3f0e45d6247449/users/a842c33752174157817dec4fc695592d/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:41:47.991068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:47.991471 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:47.991935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:48.033686 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] MFA Rules not processed for user `a842c33752174157817dec4fc695592d`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:48.034903 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:48.106809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1361/2748] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:48.119711 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:48.121153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:48.167132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:48.184778 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537311f-c55d-4abf-b469-8c8c73484b25 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:48.234913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:48.235586 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:48.235870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:48.236144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:48.244902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:48.246621 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:48.268293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1388/2749] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:51.785943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:51.787548 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:51.855577 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bd3a-860d-4fa2-8158-7587c5370e9a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:51.859867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:51.860535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:51.860985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:51.861078 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:51.863094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:51.935287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:51.936734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:51.947019 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1362/2750] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:55.185038 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:55.186518 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:55.207061 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1b69-54d7-42ef-826a-ad8509f9733b service glance] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:55.211940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:55.212919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.213266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.213607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] PATH_INFO: `/v3/users/368d131be665431ab226f20011b38c7b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.214955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] RBAC: Authorizing `identity:delete_user(user_id=368d131be665431ab226f20011b38c7b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:55.217205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:55.270655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368d131be665431ab226f20011b38c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.285734 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368d131be665431ab226f20011b38c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.286458 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368d131be665431ab226f20011b38c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.293298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368d131be665431ab226f20011b38c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.293917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bd93f300-2732-465c-9571-7755efa6336c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368d131be665431ab226f20011b38c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.311996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1389/2751] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:55 2022] DELETE /identity/v3/users/368d131be665431ab226f20011b38c7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:55.496077 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:55.508294 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068996dc-0941-4faa-9ccb-d72b88f0b76f service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:55.513161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:55.570935 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:55.571845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.572120 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.572390 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] PATH_INFO: `/v3/projects/4fd25453635947799916f1d4ce5b99cb` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.573593 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd25453635947799916f1d4ce5b99cb)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:55.575663 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:55.625134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd25453635947799916f1d4ce5b99cb', 'request_id': 'req-426a9568-606b-4f4c-bc27-96f50efcc90b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.634163 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd25453635947799916f1d4ce5b99cb', 'request_id': 'req-426a9568-606b-4f4c-bc27-96f50efcc90b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.641015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd25453635947799916f1d4ce5b99cb', 'request_id': 'req-426a9568-606b-4f4c-bc27-96f50efcc90b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.652516 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] The token cache is being invalidate because project 4fd25453635947799916f1d4ce5b99cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:55.652800 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.653479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-426a9568-606b-4f4c-bc27-96f50efcc90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:55.655089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1363/2752] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:55 2022] DELETE /identity/v3/projects/4fd25453635947799916f1d4ce5b99cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:55.660453 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.660815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.661197 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.680891 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:55.682160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:55.749264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1390/2753] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:55.760509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.760782 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.761066 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.784349 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:55.785654 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:55.797791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1364/2754] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:55.800183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:55.811021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9c204-9909-4c06-bb88-bafe817d0a05 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:55.815830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:55.816501 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.816781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.817055 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.817786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:55.818093 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:55.820112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:55.827727 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:55.834591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1391/2755] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:55.839284 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:55.848957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1034ff9-e180-488d-b487-2d88996861c9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:55.853930 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:55.854599 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.855095 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.855624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.857470 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:55.859541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:55.889407 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1365/2756] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:55 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:55.893513 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:55.904240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e1b78-4b5a-41df-9374-ffe44d2c0ade admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:55.962529 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:55.963251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:55.963539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:55.963814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:55.964528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:55.966644 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:55.990370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1392/2757] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:55 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:55.994955 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.007225 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb8cb-af93-4410-93df-55fbe7f7c12c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.012323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.013015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.013302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.013572 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.014313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.016005 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.027094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1366/2758] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:56.031610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.042819 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b471-9e22-47d3-b59a-480b8b0445ca admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.048649 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.049342 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.049620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.049890 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.050654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.052369 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623c63-678a-4872-9c4c-f99faa734bbf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.064469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1393/2759] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:56.068855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.079712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95a3e-0608-466d-af9c-7d3f475e8293 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.085302 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.086226 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.086509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.086832 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] PATH_INFO: `/v3/projects/5fd23ddafa074ccfa7c03f2c9fc6ee6d/users/479d44f16bef4ea582256fb54d01b17d/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.103137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd23ddafa074ccfa7c03f2c9fc6ee6d, user_id=479d44f16bef4ea582256fb54d01b17d, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.105785 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.121096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1367/2760] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:56 2022] PUT /identity/v3/projects/5fd23ddafa074ccfa7c03f2c9fc6ee6d/users/479d44f16bef4ea582256fb54d01b17d/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:56.132950 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.133241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.133522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.162918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] MFA Rules not processed for user `479d44f16bef4ea582256fb54d01b17d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:56.164302 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:56.236487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1394/2761] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:56.248101 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.250132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:56.287099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:56.328551 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58030c-1d4a-4e69-9b08-09eee054e314 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.334810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.335513 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.335799 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.336081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.344949 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.346565 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0693b88-6534-483c-86a3-43b398d9836c service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.355742 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1368/2762] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:56.592600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.659659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9064321-8088-40f8-8f60-24d697ec49bc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.664893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.665876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.666229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.666573 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] PATH_INFO: `/v3/users/479d44f16bef4ea582256fb54d01b17d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.668200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479d44f16bef4ea582256fb54d01b17d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.670240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.677129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:56.722244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479d44f16bef4ea582256fb54d01b17d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:56.734840 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479d44f16bef4ea582256fb54d01b17d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:56.735546 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479d44f16bef4ea582256fb54d01b17d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:56.743097 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479d44f16bef4ea582256fb54d01b17d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:56.743811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479d44f16bef4ea582256fb54d01b17d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:56.758671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1395/2763] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:41:56 2022] DELETE /identity/v3/users/479d44f16bef4ea582256fb54d01b17d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:56.763525 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.764017 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.764142 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.783223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:56.784438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:56.847322 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1369/2764] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:56.867112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:56.868887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:56.939398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6731-8d78-4dd8-8835-9b46a05a9d48 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:56.943756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:56.944469 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:56.945237 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:56.945516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:56.954979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:56.956445 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5706-1eb2-45bb-b3e9-86a8c3735101 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:56.966800 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1396/2765] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:57.266506 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.268037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:57.284094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a2f0-49c2-4834-b980-b9a12ccf90a5 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.290044 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.292297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.292960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.293311 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] PATH_INFO: `/v3/projects/5fd23ddafa074ccfa7c03f2c9fc6ee6d` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.295485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd23ddafa074ccfa7c03f2c9fc6ee6d)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.297652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.348885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd23ddafa074ccfa7c03f2c9fc6ee6d', 'request_id': 'req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:57.358165 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd23ddafa074ccfa7c03f2c9fc6ee6d', 'request_id': 'req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:57.365170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd23ddafa074ccfa7c03f2c9fc6ee6d', 'request_id': 'req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:57.375650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] The token cache is being invalidate because project 5fd23ddafa074ccfa7c03f2c9fc6ee6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:41:57.375938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:57.376560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cc6df946-8c7e-4f4e-b28c-b80b8c7c92fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:41:57.378114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1370/2766] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:41:57 2022] DELETE /identity/v3/projects/5fd23ddafa074ccfa7c03f2c9fc6ee6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:57.383217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.383720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.383952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.403638 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:57.404866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:57.469861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1397/2767] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:41:57.478023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.478312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.478587 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.497032 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:57.498299 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:57.509069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1371/2768] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:57.513496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.524387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3b27-0899-4220-8af6-110529042f06 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.530103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.530774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.531092 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.531446 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.532151 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:41:57.532420 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.534067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.547318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1398/2769] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:41:57.553288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.564952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab016-0abb-4dc6-aed9-a3740ab1943c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.571634 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.572308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.572589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.572860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.573560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.575498 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.605240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1372/2770] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:57.609625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.620299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a12-6ce6-476e-ac77-1333d1eaabff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.633758 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:57.685340 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.686023 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.686312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.686587 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.687319 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.689268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.710442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1399/2771] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:41:57.714728 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.725812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45d4a2-5790-4344-b893-6a44e39c6a9d admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.731435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.732331 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.732615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.732893 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.733638 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.735308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.748020 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1373/2772] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:41:57.752600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.765327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6e8e-e9b1-41f2-8442-47c12d580ae2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.771268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.771963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.772263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.773678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.773678 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.775056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b033d-ec7e-4926-938f-f5dd6249c2b9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.789972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1400/2773] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:57.794758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:57.800330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:57.806645 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0946d-032a-4c78-b305-e1010a042330 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:57.813414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:57.814360 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.814656 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.815003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] PATH_INFO: `/v3/projects/74f32b4c7e3f4ffc980fff8b92f2c8c3/users/edbc14a3f4e34a96adbafe04c85a0280/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.832069 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f32b4c7e3f4ffc980fff8b92f2c8c3, user_id=edbc14a3f4e34a96adbafe04c85a0280, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:57.834854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:57.852344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1374/2774] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:57 2022] PUT /identity/v3/projects/74f32b4c7e3f4ffc980fff8b92f2c8c3/users/edbc14a3f4e34a96adbafe04c85a0280/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:57.863637 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:57.863955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:57.864241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:57.893031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] MFA Rules not processed for user `edbc14a3f4e34a96adbafe04c85a0280`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:57.894247 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:57.961657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1401/2775] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:57.966608 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.029457 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db8cb-bd96-41e5-ac86-8a12207f524e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.038313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.038313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.038313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.038313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.038887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.038887 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.067655 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1375/2776] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:41:57 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:41:58.072475 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.083662 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7465ab-5cc9-46aa-b20a-452a32fc6350 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.143143 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.143837 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.144120 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.144391 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.145130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.147103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.176073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1402/2777] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:41:58 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:41:58.180402 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.191161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e6a9-81f8-46ca-836f-bd818490d3f1 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.196661 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.197342 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.197642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.197916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.198643 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.202359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.212612 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1376/2778] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:58.217178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.230166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2356-92a7-4bcf-ab49-cf60ec10e0bf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.234958 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.235877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.236157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.236462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] PATH_INFO: `/v3/projects/7ae85cc3cefe4c908578eeac309c17e3/users/0acb2c9a4c614fe08eb3e928c5e27500/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.249660 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:58.255710 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae85cc3cefe4c908578eeac309c17e3, user_id=0acb2c9a4c614fe08eb3e928c5e27500, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.258902 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.274600 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1403/2779] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:58 2022] PUT /identity/v3/projects/7ae85cc3cefe4c908578eeac309c17e3/users/0acb2c9a4c614fe08eb3e928c5e27500/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:58.279023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.289744 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337878-18e6-42c1-b413-2a1aa05933a2 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.351131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.351820 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.352129 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.352385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.353118 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.354737 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743924-7b5e-41a7-8af5-b168fd52832b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.365310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1377/2780] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:41:58.369704 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.380738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69a10-f683-425e-84bb-dd6f25dc8cbf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.385589 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.386488 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.386770 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.387084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] PATH_INFO: `/v3/projects/7ae85cc3cefe4c908578eeac309c17e3/users/0acb2c9a4c614fe08eb3e928c5e27500/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.389142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae85cc3cefe4c908578eeac309c17e3, user_id=0acb2c9a4c614fe08eb3e928c5e27500, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.391847 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.402389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1404/2781] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:41:58 2022] PUT /identity/v3/projects/7ae85cc3cefe4c908578eeac309c17e3/users/0acb2c9a4c614fe08eb3e928c5e27500/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:41:58.414379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.414729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.415145 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.442359 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] MFA Rules not processed for user `0acb2c9a4c614fe08eb3e928c5e27500`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:58.443694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:58.484138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:58.517151 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1378/2782] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:58.529013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.530897 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:58.600516 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b622a-e0bc-4ea5-b1d1-8349cf160388 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.604289 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.604942 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.605244 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.605517 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.616269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.617728 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.628408 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1405/2783] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:58.718268 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:58.728449 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed58d6-9d14-4abd-b1fb-6537238f9ce3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:58.732255 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:58.732881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:58.733160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:58.733429 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:58.791162 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:58.792867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d94a93-af53-4398-a284-391b91ae773c service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:58.803082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1379/2784] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:08.623473 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=35,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:08.798538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=40 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:17.540278 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:17.541870 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:17.611066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f654f-deaa-41b1-ad16-16e21fde15dd service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:17.616657 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:17.617557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:17.617836 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:17.618106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] PATH_INFO: `/v3/users/a842c33752174157817dec4fc695592d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:17.619431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a842c33752174157817dec4fc695592d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:17.621395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:17.670311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a842c33752174157817dec4fc695592d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:17.683552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a842c33752174157817dec4fc695592d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:17.684274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a842c33752174157817dec4fc695592d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:17.691503 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a842c33752174157817dec4fc695592d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:17.692157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a842c33752174157817dec4fc695592d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:17.706208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1406/2785] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:17 2022] DELETE /identity/v3/users/a842c33752174157817dec4fc695592d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:17.710897 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:17.711392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:17.711504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:17.729189 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:17.730392 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:17.792187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1380/2786] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:17.802620 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:17.804172 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:17.866464 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deaeaf-2753-43ad-b033-7bb0f28417bd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:17.870630 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:17.871316 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:17.871609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:17.871882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:17.881471 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:17.883184 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac80ef-152f-4ca1-9bb7-5ed36ab03e21 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:17.892863 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1407/2787] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:18.169805 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.172114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:18.185810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241d2e-0c3c-44ae-bf77-344edad5b90f None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.191772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.192794 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.192982 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.193227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] PATH_INFO: `/v3/projects/c8ffe493db56482f8f3f0e45d6247449` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.194447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ffe493db56482f8f3f0e45d6247449)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.196894 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.247872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ffe493db56482f8f3f0e45d6247449', 'request_id': 'req-714cf42f-893f-4c9a-b6ae-b51df94fd317'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:18.255691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ffe493db56482f8f3f0e45d6247449', 'request_id': 'req-714cf42f-893f-4c9a-b6ae-b51df94fd317'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:18.262999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ffe493db56482f8f3f0e45d6247449', 'request_id': 'req-714cf42f-893f-4c9a-b6ae-b51df94fd317'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:18.275543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] The token cache is being invalidate because project c8ffe493db56482f8f3f0e45d6247449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:18.275874 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:18.276487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-714cf42f-893f-4c9a-b6ae-b51df94fd317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:18.278295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1381/2788] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:18 2022] DELETE /identity/v3/projects/c8ffe493db56482f8f3f0e45d6247449 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:18.283946 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.284243 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.284528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.306797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:18.308123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:18.326069 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:18.377241 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1408/2789] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:18.385413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.385736 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.386016 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.405292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:18.406528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:18.415754 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1382/2790] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:18.420361 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.434043 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9be627-1ed7-4e8e-b3b1-2275de28ec8a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.439020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.439685 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.439993 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.440272 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.441040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:18.441348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.442995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.455636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1409/2791] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:42:18.460323 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.469709 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6497-3bfa-47c9-996b-e9c1ed77a66a None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.474913 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.475579 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.475856 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.476131 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.476914 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.478831 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.506420 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1383/2792] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:18 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:18.510773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.520980 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd61ff5-d60c-4dc0-8967-bd4c99a20953 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.582370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.583144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.583399 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.583674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.584372 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.586337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.606887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1410/2793] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:18 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:18.611056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.621718 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483f40-637d-4b59-a907-2ccc1860a262 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.627679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.628355 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.628633 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.628904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.629604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.631296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.642215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1384/2794] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:18.646334 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.657074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc9bd2-eb4f-47ac-a5a2-6c6af28b8077 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.662088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.662762 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.663079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.663474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.664271 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.665898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71465f-97c2-4413-be62-a5ebdf8d11c1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.676633 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1411/2795] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:18.681535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.696283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0c9a2-1d7e-4901-b0eb-96c815b00ffa admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.701183 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.702074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.702321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.702588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] PATH_INFO: `/v3/projects/be56100004294edabbe3138259021f89/users/725f7719314f47f89e3231b1fd988bfd/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.718814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be56100004294edabbe3138259021f89, user_id=725f7719314f47f89e3231b1fd988bfd, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.721469 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.736081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1385/2796] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:18 2022] PUT /identity/v3/projects/be56100004294edabbe3138259021f89/users/725f7719314f47f89e3231b1fd988bfd/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:18.747295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.747666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.748071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.780670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] MFA Rules not processed for user `725f7719314f47f89e3231b1fd988bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:18.781908 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:18.853188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1412/2797] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:18.864902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:18.866860 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:18.891478 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:18.930710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b0be-95f2-4634-8908-1269ac1dbbc6 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:18.934821 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:18.935472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:18.935722 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:18.935994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:18.944667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:18.946532 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bc3c-1712-4cef-967d-89350280045e service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:18.955573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1386/2798] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:28.849443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:28.951524 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=17 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:28.957112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.031219 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aaf19-a154-4155-ae23-e661b559ca1c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.036647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.037559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.037838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.038111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] PATH_INFO: `/v3/users/725f7719314f47f89e3231b1fd988bfd` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.039424 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725f7719314f47f89e3231b1fd988bfd)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.041425 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.096065 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725f7719314f47f89e3231b1fd988bfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.109933 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725f7719314f47f89e3231b1fd988bfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.110628 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725f7719314f47f89e3231b1fd988bfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.118543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725f7719314f47f89e3231b1fd988bfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.119267 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725f7719314f47f89e3231b1fd988bfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.132191 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1413/2799] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:28 2022] DELETE /identity/v3/users/725f7719314f47f89e3231b1fd988bfd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:29.137875 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.138310 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.138605 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.160312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:29.161600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.226459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1387/2800] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:29.236591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.238212 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.300765 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9f390-4aa4-4639-97d9-441e8ff765f6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.304872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.305535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.305824 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.306103 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.315735 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.317200 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb847a9d-e0ef-41f0-8d29-69b7894b1815 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.327353 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1414/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:29.601916 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.604227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.623295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd733-5df2-473c-8c20-9e5c10006d16 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.631038 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.631981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.632266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.632620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] PATH_INFO: `/v3/projects/be56100004294edabbe3138259021f89` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.633848 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be56100004294edabbe3138259021f89)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.635842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.684646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be56100004294edabbe3138259021f89', 'request_id': 'req-9b3c58c9-277a-4c94-a369-c61ec225b5e9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.693398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be56100004294edabbe3138259021f89', 'request_id': 'req-9b3c58c9-277a-4c94-a369-c61ec225b5e9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.700252 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be56100004294edabbe3138259021f89', 'request_id': 'req-9b3c58c9-277a-4c94-a369-c61ec225b5e9'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.711500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] The token cache is being invalidate because project be56100004294edabbe3138259021f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:29.711796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.712430 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-9b3c58c9-277a-4c94-a369-c61ec225b5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:29.714111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1388/2802] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:29 2022] DELETE /identity/v3/projects/be56100004294edabbe3138259021f89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:29.719265 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.719570 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.719844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.738193 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:29.739440 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.756515 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:29.802317 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1415/2803] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:29.810283 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.810576 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.810895 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.830501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:29.831714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.839727 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1389/2804] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:29.843905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.854268 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a446b-da6d-4831-a2da-c38575907ff6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.859892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.860559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.860838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.861106 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.861838 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:29.862142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.863796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.876188 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1416/2805] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:42:29.880854 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.892976 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7fc20-bbeb-462f-be1a-db0e1ce49860 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.898305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.899026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.899313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.899585 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.900281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.902238 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.930950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1390/2806] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:29 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:29.935270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.945918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081036-8d87-4319-a159-0b76f29a36f1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.008461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.009157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.009447 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.009720 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.010419 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.012394 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.041511 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1417/2807] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:29 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:30.042863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.058720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c8d9-8b5d-4636-ae91-465502428c9e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.063667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.064343 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.064627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.064902 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.065704 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.067321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.081970 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1391/2808] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:30.085985 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.096389 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad6f7-606b-44ed-a89d-1a0671cf2f7b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.101186 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.101928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.102274 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.102552 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.103341 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.104948 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf41aa-9556-4d87-952e-f9dea07363a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.115205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1418/2809] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:30.119628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.131117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8b3a-4519-48a7-a39c-feab7e53a295 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.136562 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.137505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.137819 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.138099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] PATH_INFO: `/v3/projects/7b29eae1d39c452db3e37327c5d02774/users/e0e9b7c1d95648709e1cc1025e698a29/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.154115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b29eae1d39c452db3e37327c5d02774, user_id=e0e9b7c1d95648709e1cc1025e698a29, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.156849 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.171689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1392/2810] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:30 2022] PUT /identity/v3/projects/7b29eae1d39c452db3e37327c5d02774/users/e0e9b7c1d95648709e1cc1025e698a29/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:30.181979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.182275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.182559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.210519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] MFA Rules not processed for user `e0e9b7c1d95648709e1cc1025e698a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:30.211766 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:30.280812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1419/2811] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:30.292233 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.293958 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:30.316348 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:30.355082 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e37d5-3eb7-430d-b5f3-e585d718d65a admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.359024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.359689 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.359815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.359969 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.360242 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.361198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:30.369119 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.370580 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685fef-4889-4412-a6df-fd8a0754b0a7 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.379840 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1393/2812] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:30.382054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:30.433816 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407271-b999-41e0-bc96-32f8138d3f98 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.438926 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.440167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.440167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.440393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] PATH_INFO: `/v3/users/edbc14a3f4e34a96adbafe04c85a0280` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.441560 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbc14a3f4e34a96adbafe04c85a0280)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.443540 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.494355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbc14a3f4e34a96adbafe04c85a0280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:30.507375 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbc14a3f4e34a96adbafe04c85a0280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:30.508121 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbc14a3f4e34a96adbafe04c85a0280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:30.520701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbc14a3f4e34a96adbafe04c85a0280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:30.521429 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbc14a3f4e34a96adbafe04c85a0280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:30.535525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1420/2813] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:30 2022] DELETE /identity/v3/users/edbc14a3f4e34a96adbafe04c85a0280 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:42:30.540191 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.540487 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.540803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.558589 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:30.559985 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:30.618772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1394/2814] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:30.629431 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:30.630895 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:30.694382 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352583e-5c00-448d-859d-85aeafaaad3c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:30.699148 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:30.699865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:30.700152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:30.700585 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:30.711626 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:30.713322 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:30.723849 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1421/2815] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:31.009953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.011455 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:31.023479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600041-cdc8-427a-a9f2-7d3169e2f3b0 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:31.028282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:31.029246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.029530 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.029807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] PATH_INFO: `/v3/projects/74f32b4c7e3f4ffc980fff8b92f2c8c3` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.031061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f32b4c7e3f4ffc980fff8b92f2c8c3)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:31.033036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:31.088789 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f32b4c7e3f4ffc980fff8b92f2c8c3', 'request_id': 'req-cca84758-f3e8-4ee9-83dd-2081564ee37c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.096484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f32b4c7e3f4ffc980fff8b92f2c8c3', 'request_id': 'req-cca84758-f3e8-4ee9-83dd-2081564ee37c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.102912 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f32b4c7e3f4ffc980fff8b92f2c8c3', 'request_id': 'req-cca84758-f3e8-4ee9-83dd-2081564ee37c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.114394 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] The token cache is being invalidate because project 74f32b4c7e3f4ffc980fff8b92f2c8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:31.114683 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.115436 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.117034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1395/2816] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:31 2022] DELETE /identity/v3/projects/74f32b4c7e3f4ffc980fff8b92f2c8c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:31.121133 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.131142 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feece-b282-4de7-accc-140e63ee2948 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:31.174812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:31.197688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:31.198583 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.198922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.199176 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] PATH_INFO: `/v3/users/0acb2c9a4c614fe08eb3e928c5e27500` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.200491 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0acb2c9a4c614fe08eb3e928c5e27500)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:31.202451 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:31.252988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0acb2c9a4c614fe08eb3e928c5e27500'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.265854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0acb2c9a4c614fe08eb3e928c5e27500'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.266542 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0acb2c9a4c614fe08eb3e928c5e27500'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.273443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0acb2c9a4c614fe08eb3e928c5e27500'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.274091 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-029d1c5a-73ca-4927-8036-807a9eba310d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0acb2c9a4c614fe08eb3e928c5e27500'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.287970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1422/2817] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:31 2022] DELETE /identity/v3/users/0acb2c9a4c614fe08eb3e928c5e27500 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:31.576337 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.577830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:31.591290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84758-f3e8-4ee9-83dd-2081564ee37c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:31.639057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:31.655657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:31.656546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.656823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.657096 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] PATH_INFO: `/v3/projects/7ae85cc3cefe4c908578eeac309c17e3` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.658314 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae85cc3cefe4c908578eeac309c17e3)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:31.660296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:31.707627 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae85cc3cefe4c908578eeac309c17e3', 'request_id': 'req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.717081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae85cc3cefe4c908578eeac309c17e3', 'request_id': 'req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.723745 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae85cc3cefe4c908578eeac309c17e3', 'request_id': 'req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.734538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] The token cache is being invalidate because project 7ae85cc3cefe4c908578eeac309c17e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:31.734858 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.735501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-f1a455bc-05d5-41c9-b7c0-ff864fb13c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:31.737056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1396/2818] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:31 2022] DELETE /identity/v3/projects/7ae85cc3cefe4c908578eeac309c17e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:31.742135 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.742426 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.742705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.761742 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:31.763006 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:31.828001 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1423/2819] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:31.836134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.836494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.836833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.857445 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:31.858733 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:31.867024 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1397/2820] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:31.871183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.881079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdf68a-ab54-4fc6-90b9-34c896dde4f6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:31.885941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:31.886671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.886988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.887262 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.888073 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:31.888384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:31.889996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:31.902709 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1424/2821] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:42:31.907855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.917281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5d24-c62e-4dd0-bc94-19c4653138e4 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:31.922330 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:31.923091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:31.923375 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:31.923665 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:31.924344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:31.926335 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:31.954600 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1398/2822] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:31 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:31.959088 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:31.970040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4766c-e1a3-4f1e-8edc-fe08bece1202 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.018346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:32.040217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.040925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.041223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.041760 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.042736 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.045116 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.074892 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1425/2823] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:31 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:32.076229 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.086952 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac4173-9252-47cc-b483-1c2a81c4f810 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.091621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.092288 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.092568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.092842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.093573 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.095320 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.105723 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1399/2824] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:32.110358 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.121187 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d006-1127-4ff2-b193-8908b2ddc93f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.125830 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.126496 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.126804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.127079 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.127822 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.129533 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab0f0-1f3c-4556-b4c6-37afcd5aef5d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.139894 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1426/2825] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:32.144022 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.154503 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a257c11-2a5e-4ea3-aead-d40ca7950971 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.159938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.160830 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.161115 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.161721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] PATH_INFO: `/v3/projects/d7ff012c5c6d4f48a2dc78014f3ac131/users/f7ba665a8f9047e799551fba83c1a7f2/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.176866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ff012c5c6d4f48a2dc78014f3ac131, user_id=f7ba665a8f9047e799551fba83c1a7f2, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.179657 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.194813 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1400/2826] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:32 2022] PUT /identity/v3/projects/d7ff012c5c6d4f48a2dc78014f3ac131/users/f7ba665a8f9047e799551fba83c1a7f2/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:32.206304 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.206591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.206921 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.234025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] MFA Rules not processed for user `f7ba665a8f9047e799551fba83c1a7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:32.235264 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:32.300606 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1427/2827] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:32.305942 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.371025 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4f68-ab4c-49f6-bbb4-4bf424e5e726 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.376679 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.377344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.377629 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.377904 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.378597 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.380568 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.401130 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:32.413892 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1401/2828] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:32 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:32.415085 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.426222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8af8d-f238-41fb-a774-d4c9ca419a9d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.486352 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.487060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.487387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.487639 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.488360 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.490305 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.511582 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1428/2829] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:32 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:32.515642 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.526606 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8dbd-1a57-43df-99dd-a3bf3d922a71 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.532494 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.533170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.533451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.533724 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.534459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.536106 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.547582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1402/2830] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:42:32.552074 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.563205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052305f-836b-470c-a92f-b483c97ab856 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.569465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.570713 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.571056 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.571379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] PATH_INFO: `/v3/projects/19f707718228425f9e60f11903ac9d01/users/2556b1b346ba4ccba3e90606221d80ee/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.587591 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f707718228425f9e60f11903ac9d01, user_id=2556b1b346ba4ccba3e90606221d80ee, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.590349 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.604601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1429/2831] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:32 2022] PUT /identity/v3/projects/19f707718228425f9e60f11903ac9d01/users/2556b1b346ba4ccba3e90606221d80ee/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:32.608924 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.619772 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe414-370c-4b43-9be6-73d81a00a39f admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.677690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.678409 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.678691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.679003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.679756 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.681368 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be7825-1118-4f8b-80a7-615f3bd81701 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.692153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1403/2832] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:32.697387 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.712033 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e00c-8afe-4660-9b8c-88601a624ee4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.720557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.722025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.722410 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.722696 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] PATH_INFO: `/v3/projects/19f707718228425f9e60f11903ac9d01/users/2556b1b346ba4ccba3e90606221d80ee/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.725818 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f707718228425f9e60f11903ac9d01, user_id=2556b1b346ba4ccba3e90606221d80ee, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.729864 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.743114 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1430/2833] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:32 2022] PUT /identity/v3/projects/19f707718228425f9e60f11903ac9d01/users/2556b1b346ba4ccba3e90606221d80ee/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:42:32.753706 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.754003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.754291 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.781340 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] MFA Rules not processed for user `2556b1b346ba4ccba3e90606221d80ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:32.782558 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:32.853769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1404/2834] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:32.865370 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:32.867398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:32.877972 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:32.930215 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a38040-5c03-446c-882f-7234532dca3a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:32.934489 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:32.935173 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:32.935460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:32.935737 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:32.945872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:32.947414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:32.957567 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1431/2835] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:33.007378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:33.009117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:33.022336 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226b3f1-a5a1-4605-8cc5-b03e0451a8b9 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:33.027042 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:33.027695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:33.027954 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:33.028248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:33.087867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:33.089327 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d390f7-df00-48d7-af1f-995833acc5bb service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:33.098439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1405/2836] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:35.403752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:35.405384 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:35.472462 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ddfb-15a0-4427-aefd-466708f01831 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:35.477877 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:35.478740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:35.479076 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:35.479348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] PATH_INFO: `/v3/users/e0e9b7c1d95648709e1cc1025e698a29` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:35.480676 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e9b7c1d95648709e1cc1025e698a29)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:35.482634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:35.531500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e9b7c1d95648709e1cc1025e698a29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.543259 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e9b7c1d95648709e1cc1025e698a29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.543922 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e9b7c1d95648709e1cc1025e698a29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.550810 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e9b7c1d95648709e1cc1025e698a29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.551468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e9b7c1d95648709e1cc1025e698a29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.564755 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1432/2837] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:35 2022] DELETE /identity/v3/users/e0e9b7c1d95648709e1cc1025e698a29 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:35.569385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:35.569876 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:35.569973 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:35.582195 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:35.588317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:35.589523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:35.653447 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1406/2838] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:35.663441 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:35.665128 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:35.700450 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:35.727930 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f090-24e1-40d5-a28b-7fb86777c897 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:35.731823 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:35.732479 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:35.732844 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:35.733123 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:35.742480 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:35.743965 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a415e0-fea7-4c62-9ac0-6ed6104626f5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:35.753866 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1433/2839] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:36.041537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.043081 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.056534 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54dd6-3fb5-4968-b1c7-b2d9f4b7c708 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.061796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.063240 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.063514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.063945 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] PATH_INFO: `/v3/projects/7b29eae1d39c452db3e37327c5d02774` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.065164 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b29eae1d39c452db3e37327c5d02774)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.067105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.114501 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b29eae1d39c452db3e37327c5d02774', 'request_id': 'req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.122864 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b29eae1d39c452db3e37327c5d02774', 'request_id': 'req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.129182 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b29eae1d39c452db3e37327c5d02774', 'request_id': 'req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.139444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] The token cache is being invalidate because project 7b29eae1d39c452db3e37327c5d02774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:36.139731 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.140421 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-a80e0f5c-11ad-448d-8171-aa9cd6442f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.142009 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1407/2840] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:36 2022] DELETE /identity/v3/projects/7b29eae1d39c452db3e37327c5d02774 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:36.147414 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.147701 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.147979 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.167607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:36.168927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.231659 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1434/2841] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:36.241037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.241321 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.241604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.261721 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:36.262957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.271263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1408/2842] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:36.275622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.285739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44980-d690-4bc9-b79c-812374b44193 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.291202 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.291859 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.292130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.292415 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.293129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:36.293428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.295071 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.311054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1435/2843] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:42:36.312353 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.321951 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f27a8-a3ec-4ef6-a1a2-0b0d6c69aaca None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.327361 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.328037 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.328326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.328603 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.329290 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.331388 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.357269 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1409/2844] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:36.361917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.372858 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a9e1-749f-414b-bbf6-290e87bb11bd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.432974 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.433674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.433920 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.434157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.434901 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.436887 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.446707 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.449139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.459017 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1436/2845] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:36.462995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.463535 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f592-6a28-408b-a429-4d30a410e808 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.468651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.469547 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.469827 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.470103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] PATH_INFO: `/v3/users/f7ba665a8f9047e799551fba83c1a7f2` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.471373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ba665a8f9047e799551fba83c1a7f2)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.472482 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bde06-7603-4b33-99bb-429fa211f81e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.473344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.477487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.478379 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.478872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.479153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.479882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.481524 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.494325 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1437/2846] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:42:36.499041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.510852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89eda-336b-46d9-a2de-cafbc7bb7cb7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.516205 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.516925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.517226 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.517492 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.518310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.519967 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.527811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ba665a8f9047e799551fba83c1a7f2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.531275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1438/2847] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:36.535468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.537766 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:36.544223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ba665a8f9047e799551fba83c1a7f2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.545193 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ba665a8f9047e799551fba83c1a7f2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.546398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd186d5-c13f-4573-9f7e-824818afa20c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.551705 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.552580 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.552885 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.553156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] PATH_INFO: `/v3/projects/e441da94dbd54415ad25cb8428330b3a/users/75d58991e4e046508bdf74492e4fb7cd/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.554459 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ba665a8f9047e799551fba83c1a7f2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.555154 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-01fa8e19-2bb7-4b82-b520-d3b5bab1e121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ba665a8f9047e799551fba83c1a7f2'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.568519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1410/2848] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:36 2022] DELETE /identity/v3/users/f7ba665a8f9047e799551fba83c1a7f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:36.571124 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e441da94dbd54415ad25cb8428330b3a, user_id=75d58991e4e046508bdf74492e4fb7cd, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.573624 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.574090 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.574201 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.574311 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1756ff9-6708-4971-acdf-b0decb5d33b6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.589507 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1439/2849] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:36 2022] PUT /identity/v3/projects/e441da94dbd54415ad25cb8428330b3a/users/75d58991e4e046508bdf74492e4fb7cd/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:42:36.591809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:36.593306 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.594625 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.594964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.595246 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.600909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:36.613868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:36.615130 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.653491 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1411/2850] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:36.663297 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.664644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.675443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1440/2851] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:36.684917 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.686509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.721500 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf984-ffb2-44f3-9418-9da1039318d6 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.725161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.725841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.726149 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.726408 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.735537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.737170 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.744251 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c809-c849-4e9c-ac5f-4eeaa5af389e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.747981 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1412/2852] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:36.748115 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.748634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.748918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.749196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.759599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.761153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.771216 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1441/2853] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:37.095943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:37.097823 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:37.131505 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549240ac-5b54-4c79-a663-2ba6ac110a8b service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:37.139332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:37.140347 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:37.140639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:37.140917 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] PATH_INFO: `/v3/projects/d7ff012c5c6d4f48a2dc78014f3ac131` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:37.142227 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ff012c5c6d4f48a2dc78014f3ac131)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:37.144202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:37.207196 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ff012c5c6d4f48a2dc78014f3ac131', 'request_id': 'req-5e53994f-8778-47c2-8c92-86aeddf0da2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.218332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ff012c5c6d4f48a2dc78014f3ac131', 'request_id': 'req-5e53994f-8778-47c2-8c92-86aeddf0da2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.226247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ff012c5c6d4f48a2dc78014f3ac131', 'request_id': 'req-5e53994f-8778-47c2-8c92-86aeddf0da2c'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.235778 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:37.240983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] The token cache is being invalidate because project d7ff012c5c6d4f48a2dc78014f3ac131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:37.241451 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.242999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.248381 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1413/2854] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:37 2022] DELETE /identity/v3/projects/d7ff012c5c6d4f48a2dc78014f3ac131 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:37.249746 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:37.260292 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e60ba-37d2-4660-a703-3bbb67b7bf21 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:37.318535 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:37.319549 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:37.319952 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:37.320692 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] PATH_INFO: `/v3/users/2556b1b346ba4ccba3e90606221d80ee` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:37.322047 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2556b1b346ba4ccba3e90606221d80ee)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:37.324122 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:37.373131 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2556b1b346ba4ccba3e90606221d80ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.374273 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:37.386900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2556b1b346ba4ccba3e90606221d80ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.387605 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2556b1b346ba4ccba3e90606221d80ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.395988 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2556b1b346ba4ccba3e90606221d80ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.396959 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dd28b2ad-0d66-415b-b0b9-95ba833d2f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2556b1b346ba4ccba3e90606221d80ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.411293 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1442/2855] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:37 2022] DELETE /identity/v3/users/2556b1b346ba4ccba3e90606221d80ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:42:37.715833 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:37.717883 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:37.739980 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53994f-8778-47c2-8c92-86aeddf0da2c admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:37.812496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:37.813684 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:37.814169 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:37.815083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] PATH_INFO: `/v3/projects/19f707718228425f9e60f11903ac9d01` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:37.816561 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f707718228425f9e60f11903ac9d01)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:37.819125 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:37.877354 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f707718228425f9e60f11903ac9d01', 'request_id': 'req-496f133f-4e42-46b5-bd13-feafbd666ce8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.889107 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f707718228425f9e60f11903ac9d01', 'request_id': 'req-496f133f-4e42-46b5-bd13-feafbd666ce8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.896111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f707718228425f9e60f11903ac9d01', 'request_id': 'req-496f133f-4e42-46b5-bd13-feafbd666ce8'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.908719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] The token cache is being invalidate because project 19f707718228425f9e60f11903ac9d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:37.909056 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.911239 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-496f133f-4e42-46b5-bd13-feafbd666ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:37.913079 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1414/2856] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:37 2022] DELETE /identity/v3/projects/19f707718228425f9e60f11903ac9d01 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:37.919261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:37.919796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:37.919898 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:37.944070 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:37.945876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:38.025283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1443/2857] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:38.034312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.034650 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.034966 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.054550 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:38.055845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:38.064287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1415/2858] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:38.068936 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.080208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0adff-b78a-45cc-81f2-8c5a5e2cfbb7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.085179 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.085963 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.086312 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.086654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.087522 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:38.087927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.089693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.104012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1444/2859] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:42:38.108602 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.119543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d609b-df23-4629-97ca-79986a92e882 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.125419 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.126544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.126544 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.126750 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.127444 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.129509 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.160286 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1416/2860] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:38 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:42:38.164786 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.177346 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028911-e847-4f26-b2c0-37c9545ae933 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.255790 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.256581 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.256937 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.257285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.258066 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.260233 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.283833 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1445/2861] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:38 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:38.288006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.299486 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892816e-30fe-4b82-8e76-80873f0c69fc admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.306546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.308114 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.308760 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.309690 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.311344 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.315128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.330906 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1417/2862] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:38.336707 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.347609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4115-1907-4437-98ec-362efa216f17 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.352717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.353402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.353686 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.354083 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.354856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.356500 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae0014-cfca-4a55-82b2-060d05869f1b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.370982 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1446/2863] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:38.372791 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.384527 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93066e3-3926-484b-aa42-74f6531f4c99 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.390401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.391369 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.391702 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.391983 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] PATH_INFO: `/v3/projects/cd2ecc41f1f8411aae37423c9c39d54e/users/bbb2065aa0554a71a0b7364ad3c30b8c/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.413292 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2ecc41f1f8411aae37423c9c39d54e, user_id=bbb2065aa0554a71a0b7364ad3c30b8c, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.416267 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.447521 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1418/2864] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:38 2022] PUT /identity/v3/projects/cd2ecc41f1f8411aae37423c9c39d54e/users/bbb2065aa0554a71a0b7364ad3c30b8c/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:38.458166 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe169-0d0f-467a-a459-522509715ab4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.458454 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe169-0d0f-467a-a459-522509715ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.458740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe169-0d0f-467a-a459-522509715ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.499052 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-19dbe169-0d0f-467a-a459-522509715ab4 None None] MFA Rules not processed for user `bbb2065aa0554a71a0b7364ad3c30b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:38.500298 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-19dbe169-0d0f-467a-a459-522509715ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:38.524954 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:38.581706 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1447/2865] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:38.593851 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:38.595734 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:38.634523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:38.692364 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa67fb-0150-4017-bf69-4c580379ab32 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:38.696467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94620d53b108470b9aebafcb5a8c38c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:38.697295 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:38.697433 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:38.697671 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:38.707439 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:38.708899 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:38.721325 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1419/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:41.168355 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.168909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.168909 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.205964 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] MFA Rules not processed for user `75d58991e4e046508bdf74492e4fb7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:41.207499 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:41.280427 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1448/2867] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:41.285068 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.286552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:41.369472 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c09d0-f5a5-40b4-bf3f-37bcd6d5e792 service glance] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.374280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.374999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.375281 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.375564 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.376277 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.378221 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.406546 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1420/2868] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:41.411014 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.423266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b3cd2-2ed6-48d2-943f-2ada8ad8c62a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.489739 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.490509 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.490814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.491102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.491812 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.493876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.520068 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1449/2869] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:41 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:41.521263 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.533026 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98dfe8-6f02-4652-9c26-66e51e0aab07 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.538218 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.539034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.539384 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.539730 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.540536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.542187 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.555084 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1421/2870] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:41.559295 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.569635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c94f0-ae64-4b94-8ae0-dc72fddc540e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.574956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.575874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.576157 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.576467 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] PATH_INFO: `/v3/projects/cb1e2d0dea2c4829af1e277fd963c576/users/6770533cf7ed4ea0baa41a0e4adba414/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.592095 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1e2d0dea2c4829af1e277fd963c576, user_id=6770533cf7ed4ea0baa41a0e4adba414, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.594804 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.610740 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1450/2871] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:41 2022] PUT /identity/v3/projects/cb1e2d0dea2c4829af1e277fd963c576/users/6770533cf7ed4ea0baa41a0e4adba414/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:41.614963 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.626373 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91d1d-907a-487c-b882-e0d4a3876073 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.687076 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.687762 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.688011 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.688298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.689003 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.690604 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9c43f-d318-475e-b191-9d39ac315256 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.702518 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1422/2872] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:41.707127 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:41.718688 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6b1e-241d-4e9f-95d1-39472f9b5846 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:41.725318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:41.726269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:41.726562 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:41.726876 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] PATH_INFO: `/v3/projects/cb1e2d0dea2c4829af1e277fd963c576/users/6770533cf7ed4ea0baa41a0e4adba414/roles/f2f6ba9fba3448b48067a6e828b81c42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:41.729430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1e2d0dea2c4829af1e277fd963c576, user_id=6770533cf7ed4ea0baa41a0e4adba414, role_id=f2f6ba9fba3448b48067a6e828b81c42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:41.732224 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:41.744494 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1451/2873] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:41 2022] PUT /identity/v3/projects/cb1e2d0dea2c4829af1e277fd963c576/users/6770533cf7ed4ea0baa41a0e4adba414/roles/f2f6ba9fba3448b48067a6e828b81c42 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:46.552626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6569-34ee-49ec-990c-9b5116cf70b8 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:46.553215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6569-34ee-49ec-990c-9b5116cf70b8 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:46.553215 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6569-34ee-49ec-990c-9b5116cf70b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:46.583385 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-326d6569-34ee-49ec-990c-9b5116cf70b8 None None] MFA Rules not processed for user `6770533cf7ed4ea0baa41a0e4adba414`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:46.584630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-326d6569-34ee-49ec-990c-9b5116cf70b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:46.595370 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:46.706538 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1423/2874] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:46.722913 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:46.725468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:46.732914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:46.824207 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547b3d-041d-40dc-a2c8-fbd7973a431d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:46.833674 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:46.834363 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:46.834647 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:46.834956 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:46.894045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:46.895708 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:46.905112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1452/2875] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:47.962943 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d0f0-5597-4c07-bac2-9efdbdd7fba6 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:47.963467 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d0f0-5597-4c07-bac2-9efdbdd7fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:47.963601 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d0f0-5597-4c07-bac2-9efdbdd7fba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:47.984867 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-9308d0f0-5597-4c07-bac2-9efdbdd7fba6 None None] MFA Rules not processed for user `75d58991e4e046508bdf74492e4fb7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:47.986099 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-9308d0f0-5597-4c07-bac2-9efdbdd7fba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:47.994074 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1424/2876] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:56.900717 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=55 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:57.977941 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=28 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:59.773681 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:59.844162 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680f34-1a86-4589-b0cc-a58a37802183 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:59.848970 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:59.849867 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:59.850154 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:59.850432 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] PATH_INFO: `/v3/users/bbb2065aa0554a71a0b7364ad3c30b8c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:59.851848 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb2065aa0554a71a0b7364ad3c30b8c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:59.853774 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:59.906366 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb2065aa0554a71a0b7364ad3c30b8c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:59.919543 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb2065aa0554a71a0b7364ad3c30b8c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:59.920240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb2065aa0554a71a0b7364ad3c30b8c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:59.927096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb2065aa0554a71a0b7364ad3c30b8c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:59.927719 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb2065aa0554a71a0b7364ad3c30b8c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:59.944539 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1453/2877] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:59 2022] DELETE /identity/v3/users/bbb2065aa0554a71a0b7364ad3c30b8c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:59.949812 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:59.950346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:59.950346 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:59.968623 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:59.969964 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:00.033192 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1425/2878] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:00.043013 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.044448 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:00.106461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7382-7227-4760-97f8-9c1703d7dd75 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.110996 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.111670 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.111955 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.112229 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.121912 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.123428 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17334-b7c5-437e-9229-2a23a8e3b227 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.133724 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1454/2879] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:00.419479 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.421698 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:00.439957 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb482d4-1cd9-47d1-9f8e-3611ed31cf33 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.447835 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.448729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.449006 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.449313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] PATH_INFO: `/v3/projects/cd2ecc41f1f8411aae37423c9c39d54e` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.450560 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2ecc41f1f8411aae37423c9c39d54e)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.452716 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.500543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2ecc41f1f8411aae37423c9c39d54e', 'request_id': 'req-7359bfef-0cd2-448f-a3f0-482ec8427091'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:00.511161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2ecc41f1f8411aae37423c9c39d54e', 'request_id': 'req-7359bfef-0cd2-448f-a3f0-482ec8427091'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:00.522113 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2ecc41f1f8411aae37423c9c39d54e', 'request_id': 'req-7359bfef-0cd2-448f-a3f0-482ec8427091'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:00.538484 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] The token cache is being invalidate because project cd2ecc41f1f8411aae37423c9c39d54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:43:00.538796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:00.539514 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7359bfef-0cd2-448f-a3f0-482ec8427091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:00.541152 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1426/2880] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:43:00 2022] DELETE /identity/v3/projects/cd2ecc41f1f8411aae37423c9c39d54e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:00.547899 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.548183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.548460 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.572547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:00.573782 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:00.592861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:00.644140 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1455/2881] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:00.652298 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.652646 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.652938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.672177 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:00.673425 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:00.682666 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1427/2882] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:43:00.687190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.697960 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a352a-900c-4c53-9d83-9e7f5e4e49e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.703561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.704222 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.704508 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.704781 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.705525 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:43:00.705834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.707502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.719653 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1456/2883] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:43:00.724423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.734537 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbf213-2ac1-41df-a6dd-74595d12feb3 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.740213 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.740877 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.741161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.741435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.742132 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.744094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.775315 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1428/2884] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:43:00 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:00.778797 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.794481 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedb0d2-9964-4d55-8bdc-9723c5ae92e9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.853359 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.854031 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.854310 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.854579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.855299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.857225 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.879437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1457/2885] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:43:00 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:00.885552 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.896712 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabda5-88d5-4e8a-badb-e1a7dbfd850e admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.901869 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.902541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.902852 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.903138 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.903872 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.905497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.916275 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1429/2886] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:00.920228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.930443 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a3e0d-e03f-4b8c-8eef-2bd87e0d22c9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.936356 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.937012 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.937287 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.937559 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.938291 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.939914 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69280a65-73cf-4347-b121-06775d89e439 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:00.950888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1458/2887] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:43:00.955287 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:00.966582 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e681e-3b04-4fbc-9335-612266ffde69 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:00.971938 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:00.972845 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:00.973128 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:00.973401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] PATH_INFO: `/v3/projects/2358386f9aec43b28d207dcd09c021e4/users/6de66b62d86c4f2a9632accd3d569b01/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:00.988953 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2358386f9aec43b28d207dcd09c021e4, user_id=6de66b62d86c4f2a9632accd3d569b01, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:00.991796 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:01.006380 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1430/2888] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:00 2022] PUT /identity/v3/projects/2358386f9aec43b28d207dcd09c021e4/users/6de66b62d86c4f2a9632accd3d569b01/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:01.073465 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:01.073783 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:01.074060 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:01.101393 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] MFA Rules not processed for user `6de66b62d86c4f2a9632accd3d569b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:01.102579 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:01.170882 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1459/2889] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:01.181967 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:01.183920 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:01.207249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:01.247810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63011fde-fed2-4587-b1fa-d9123ebb70bd admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:01.252033 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:01.252695 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:01.252975 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:01.253248 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:01.261890 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:01.263418 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05a42b-c64a-4d40-bd60-98676be077c0 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:01.272329 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1431/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:07.690461 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:07.712081 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:07.758118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076de930-716a-4d94-8dab-f2def6d962b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:07.763442 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:07.764337 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:07.764622 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:07.764900 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] PATH_INFO: `/v3/users/6de66b62d86c4f2a9632accd3d569b01` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:07.766220 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de66b62d86c4f2a9632accd3d569b01)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:07.768198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:07.824261 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de66b62d86c4f2a9632accd3d569b01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:07.836608 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de66b62d86c4f2a9632accd3d569b01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:07.837300 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de66b62d86c4f2a9632accd3d569b01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:07.844395 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de66b62d86c4f2a9632accd3d569b01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:07.845040 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de66b62d86c4f2a9632accd3d569b01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:07.860772 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1460/2891] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:43:07 2022] DELETE /identity/v3/users/6de66b62d86c4f2a9632accd3d569b01 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:07.865443 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:07.865933 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:07.866057 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:07.883541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:07.884758 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:07.949485 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1432/2892] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:07.959561 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:07.961270 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.021769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7018ef-b3d1-438d-92d1-b068e4500f79 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.026217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.026856 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.027169 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.027438 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.037969 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.039468 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9693-88db-4261-bab7-ca52c81fa328 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.049167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1461/2893] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:08.325015 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.326545 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.340105 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d2d3-77b8-4650-8d58-f595f9c1e62c None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.345780 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.346769 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.347083 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.347395 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] PATH_INFO: `/v3/projects/2358386f9aec43b28d207dcd09c021e4` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.349619 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2358386f9aec43b28d207dcd09c021e4)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.351630 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.398841 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2358386f9aec43b28d207dcd09c021e4', 'request_id': 'req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:08.406880 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2358386f9aec43b28d207dcd09c021e4', 'request_id': 'req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:08.413023 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2358386f9aec43b28d207dcd09c021e4', 'request_id': 'req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:08.424117 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] The token cache is being invalidate because project 2358386f9aec43b28d207dcd09c021e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:43:08.424401 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:08.425043 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-43e0dae6-dc0f-4d3c-b71e-ee09b4d6cb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:08.426607 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1433/2894] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:43:08 2022] DELETE /identity/v3/projects/2358386f9aec43b28d207dcd09c021e4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:08.431671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.431868 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.432283 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.451054 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:08.452263 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.492769 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:08.524223 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1462/2895] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:08.532305 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.532592 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.532866 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.551432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:08.552626 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.560752 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1434/2896] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:08.564927 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.575348 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7499827-d7c4-4695-af03-f45bce113464 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.580554 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.581301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.581646 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.581981 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.582716 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:43:08.583158 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.584808 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.597152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1463/2897] 10.222.0.57 () {58 vars in 1152 bytes} [Fri Jul 15 19:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:43:08.601536 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.611543 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093b22-a98d-4fa0-b9ca-43711c4fc31d None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.617968 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.618659 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.618991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.619289 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.620064 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.622160 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.648863 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1435/2898] 10.222.0.57 () {60 vars in 1152 bytes} [Fri Jul 15 19:43:08 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:08.653502 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.663852 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed2d2-6e57-4896-b5b2-e76d891fbadb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.723853 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.724536 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.724811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.725078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.725751 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.727693 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.751771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1464/2899] 10.222.0.57 () {60 vars in 1143 bytes} [Fri Jul 15 19:43:08 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:08.753404 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.765186 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71e4-beeb-4f71-8c8b-4751834891b7 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.770595 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.771332 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.771615 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.771911 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.772639 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.774273 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.785948 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1436/2900] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:43:08.790402 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.801190 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883fb9-4967-448a-9e9c-53753e49f7fb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.804416 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.806165 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.806313 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.806879 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.807208 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.807486 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.808228 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.809842 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.817435 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:08.824318 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1465/2901] 10.222.0.57 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:08.825313 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:08.835597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0352-afa8-4a0d-ac63-5bc2fb6b93d5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.840266 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.841137 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.841423 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.841700 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] PATH_INFO: `/v3/projects/85a4875e05064057b9746933665ffa7f/users/9d719bc94a5941d88dc85e8b49fde1d2/roles/8a808717b2bd475fa487b6efe8f100ba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.857084 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a4875e05064057b9746933665ffa7f, user_id=9d719bc94a5941d88dc85e8b49fde1d2, role_id=8a808717b2bd475fa487b6efe8f100ba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.859938 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a823be-c25f-4b22-a4f6-4e72f1920aad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.868414 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78401-ff7d-4b29-8779-a1724e4473d8 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:08.874558 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1466/2902] 10.222.0.57 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:08 2022] PUT /identity/v3/projects/85a4875e05064057b9746933665ffa7f/users/9d719bc94a5941d88dc85e8b49fde1d2/roles/8a808717b2bd475fa487b6efe8f100ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:08.885872 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.886160 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.886437 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.913020 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] MFA Rules not processed for user `9d719bc94a5941d88dc85e8b49fde1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:08.914260 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.917442 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:08.918111 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:08.918398 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:08.918672 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:08.920529 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:08.929991 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:08.931502 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:08.939581 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1437/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:43:08.979282 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1467/2904] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:43:09.010308 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:09.011881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.071235 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107f44-e192-40f7-aaba-f01f3d446ece service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:09.075326 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74a111fbdcd64c0fa65e2ecbd0fdc4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:09.075999 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.076280 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.076554 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.085855 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:09.087367 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724e17-a6e0-4b3a-aaec-6cf2a8977057 service cinder] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:09.096761 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1438/2905] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:09.113306 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:09.127150 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:09.185918 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954b79b-e1e1-484f-96f7-323fcf636471 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:09.190636 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:09.191654 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.191940 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.192217 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] PATH_INFO: `/v3/users/9d719bc94a5941d88dc85e8b49fde1d2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.193472 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d719bc94a5941d88dc85e8b49fde1d2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:09.195941 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:09.246156 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d719bc94a5941d88dc85e8b49fde1d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.258378 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d719bc94a5941d88dc85e8b49fde1d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.259327 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d719bc94a5941d88dc85e8b49fde1d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.266421 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d719bc94a5941d88dc85e8b49fde1d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.267240 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d719bc94a5941d88dc85e8b49fde1d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.282204 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1468/2906] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:43:09 2022] DELETE /identity/v3/users/9d719bc94a5941d88dc85e8b49fde1d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:09.287230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] REQUEST_METHOD: `POST` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.287526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.287803 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.305423 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.auth.core [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] MFA Rules not processed for user `72ba3f2f992c417989b7e2463df4d263`. Rule list: `[]` (Enabled: `True`). {{(pid=80225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:09.306651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.379123 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1439/2907] 10.222.0.57 () {58 vars in 957 bytes} [Fri Jul 15 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:09.387645 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:09.389167 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.401378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:09.402826 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.415282 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=100 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:09.461883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdcff4-01a1-4e36-a12e-b9fe4aa176ef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:09.465888 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:09.466555 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.466862 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.467132 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.476557 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:09.478005 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:09.481667 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70514527-8454-4c2f-8d2e-27951f913f81 None None] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:09.486570 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:09.487259 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.487542 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.487822 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.488045 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1469/2908] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:09.489620 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.501413 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:09.503029 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:09.513088 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1440/2909] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:43:09.772671 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:09.777102 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:09.788999 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4e15-3acd-40e4-ab10-563465273bd8 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:09.797743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:09.797743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:09.797743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:09.797743 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] PATH_INFO: `/v3/projects/85a4875e05064057b9746933665ffa7f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:09.800404 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a4875e05064057b9746933665ffa7f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:09.802336 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:09.840777 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:09.859834 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a4875e05064057b9746933665ffa7f', 'request_id': 'req-20cf6562-0f82-4937-8fe0-da24963bb88b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.867796 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a4875e05064057b9746933665ffa7f', 'request_id': 'req-20cf6562-0f82-4937-8fe0-da24963bb88b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.874919 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a4875e05064057b9746933665ffa7f', 'request_id': 'req-20cf6562-0f82-4937-8fe0-da24963bb88b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.886881 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] The token cache is being invalidate because project 85a4875e05064057b9746933665ffa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:43:09.887269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.888002 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:09.889607 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1470/2910] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:43:09 2022] DELETE /identity/v3/projects/85a4875e05064057b9746933665ffa7f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:11.300984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:11.302496 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:11.314885 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668a4-bd39-482f-ab3a-3a57228f0513 service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:11.366312 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:11.367007 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:11.367293 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:11.367571 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:11.369596 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:11.380811 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:11.382621 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:11.390950 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1441/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:18.913433 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:18.915435 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.006459 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6562-0f82-4937-8fe0-da24963bb88b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:19.011865 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:19.012519 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:19.012805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:19.013078 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:19.014875 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.026632 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:19.028301 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:19.039153 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1471/2912] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:21.387139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=54 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:21.521520 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:21.523089 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:21.534497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1f906-70df-4c76-832a-c349e2b2e30e service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:21.538644 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:21.539317 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:21.539609 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:21.539882 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:21.541725 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:21.613764 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:21.615246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:21.625214 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1442/2913] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:23.489339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:23.501105 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa6354-ef18-47eb-9c61-33dfb02ccc37 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:23.507059 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:23.507791 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:23.508144 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:23.508430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:23.510339 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:23.523009 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:23.524610 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:23.536196 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1472/2914] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:31.620710 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=30 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:33.531275 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=54,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:59.838432 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:59.840161 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:59.913925 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761ef3-2c57-42ce-b422-8c7906d4c428 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:59.920767 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:59.921431 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:59.921720 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:59.921994 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:59.924497 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:59.938358 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:59.940061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:59.951175 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1443/2915] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:09.946504 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=32 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:54.546634 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:54.548199 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:54.561594 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b8e0-2792-4bfb-ae34-f21cf87bddb6 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:54.566599 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:54.567281 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:54.567571 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:54.567841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:54.569928 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:54.584547 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:54.585995 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:54.597588 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1473/2916] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:58.146588 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:58.160960 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c2ff-b171-4b48-8563-fb2630360bb5 service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:58.167147 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:58.167806 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:58.168061 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:58.168341 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:58.170729 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:58.186809 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:58.188296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:58.201141 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1444/2917] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:04.592738 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:05.413754 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:05.422978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9163-4658-42a9-90b3-689b93b7b37e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:05.426773 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:05.427474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:05.427756 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:05.428067 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:05.429850 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:05.440111 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:05.442631 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:05.452805 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1474/2918] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:06.543651 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:06.554713 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51adc5c-ac5f-4183-9d71-96b2b17f6e15 service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:06.559137 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:06.559926 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:06.560216 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:06.560483 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:06.562575 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:06.577628 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:06.579139 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:06.590476 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1445/2919] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:15.449907 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:16.585658 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=12 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:56.748597 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:56.764551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0a4b-9218-4483-aad5-383330361a76 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:56.770978 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:56.771642 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:56.771925 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:56.772198 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:56.774430 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:56.840152 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:56.841613 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:56.851183 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1475/2920] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:57.963244 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:57.976223 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05832d-49a3-404c-b6c9-2a0c52fda60a service neutron] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:57.982178 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876435c9cdf4e11a6d193017d53ed49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:57.982691 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:57.982940 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:57.983217 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:57.985528 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:57.999094 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:58.000694 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:58.012881 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1446/2921] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:48:01.839367 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:01.848299 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56f60e-d259-4394-b9f9-7bfe0252e7ee service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:01.851880 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3386325f72224ab1b9719855b1fbbdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:01.852528 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:01.852811 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:01.853090 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:01.854874 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:01.921098 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:01.922551 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:01.932617 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1476/2922] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:48:04.785378 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:04.809468 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82169-de26-4a5b-9588-a1a616446614 service nova] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:04.815134 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:04.815984 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] REQUEST_METHOD: `GET` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:04.816266 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:04.816541 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:04.818377 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:04.832618 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:04.835034 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:04.848415 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1447/2923] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:48:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:48:08.046861 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:08.048474 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:08.070269 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c295-2e4b-43ec-80f1-8cd6147febb5 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:08.078883 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:08.079905 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:08.080416 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:08.080957 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] PATH_INFO: `/v3/users/75d58991e4e046508bdf74492e4fb7cd` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:08.083118 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d58991e4e046508bdf74492e4fb7cd)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:08.085178 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:08.140841 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d58991e4e046508bdf74492e4fb7cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.159609 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d58991e4e046508bdf74492e4fb7cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.160381 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d58991e4e046508bdf74492e4fb7cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.170112 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d58991e4e046508bdf74492e4fb7cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.171041 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d58991e4e046508bdf74492e4fb7cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.184904 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1477/2924] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:48:08 2022] DELETE /identity/v3/users/75d58991e4e046508bdf74492e4fb7cd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:48:08.361246 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:08.375249 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a72-8f5d-40d6-9ccf-667addb4505f service placement] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:08.442814 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:08.444091 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:08.444438 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:08.444818 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] PATH_INFO: `/v3/projects/e441da94dbd54415ad25cb8428330b3a` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:08.446296 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e441da94dbd54415ad25cb8428330b3a)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:08.449519 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:08.500842 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e441da94dbd54415ad25cb8428330b3a', 'request_id': 'req-88853949-ad4f-4882-bf3a-b455c1a7f433'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.509523 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e441da94dbd54415ad25cb8428330b3a', 'request_id': 'req-88853949-ad4f-4882-bf3a-b455c1a7f433'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.515962 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e441da94dbd54415ad25cb8428330b3a', 'request_id': 'req-88853949-ad4f-4882-bf3a-b455c1a7f433'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.526719 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] The token cache is being invalidate because project e441da94dbd54415ad25cb8428330b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:48:08.527036 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.527652 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.529230 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1448/2925] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:48:08 2022] DELETE /identity/v3/projects/e441da94dbd54415ad25cb8428330b3a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:48:08.533521 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:08.534966 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:08.544331 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:08.548477 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c99b-f2c1-424f-a50c-b1d73553f017 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:08.609021 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:08.609893 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:08.610168 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:08.610439 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] PATH_INFO: `/v3/users/6770533cf7ed4ea0baa41a0e4adba414` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:08.611771 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6770533cf7ed4ea0baa41a0e4adba414)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:08.613655 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:08.664973 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6770533cf7ed4ea0baa41a0e4adba414'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.678129 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6770533cf7ed4ea0baa41a0e4adba414'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.678854 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6770533cf7ed4ea0baa41a0e4adba414'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.686096 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6770533cf7ed4ea0baa41a0e4adba414'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.686752 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6770533cf7ed4ea0baa41a0e4adba414'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:08.702601 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1478/2926] 10.222.0.57 () {58 vars in 1223 bytes} [Fri Jul 15 19:48:08 2022] DELETE /identity/v3/users/6770533cf7ed4ea0baa41a0e4adba414 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:48:08.882379 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Authenticating user token {{(pid=80225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:08.884202 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.fernet_utils [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:08.900181 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853949-ad4f-4882-bf3a-b455c1a7f433 admin admin] Validating token access rules against request {{(pid=80225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:08.961617 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ba3f2f992c417989b7e2463df4d263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d82d6637d8c4815a3aaa31f204adffe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:08.962526 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:08.962807 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:08.963103 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] PATH_INFO: `/v3/projects/cb1e2d0dea2c4829af1e277fd963c576` {{(pid=80225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:08.964417 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1e2d0dea2c4829af1e277fd963c576)` {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:08.966339 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] RBAC: Authorization granted {{(pid=80225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:08.973153 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:09.018050 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1e2d0dea2c4829af1e277fd963c576', 'request_id': 'req-7702f8fc-299c-404c-9726-facf5959cddb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:09.025714 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1e2d0dea2c4829af1e277fd963c576', 'request_id': 'req-7702f8fc-299c-404c-9726-facf5959cddb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:09.031810 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1e2d0dea2c4829af1e277fd963c576', 'request_id': 'req-7702f8fc-299c-404c-9726-facf5959cddb'} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:09.042247 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] The token cache is being invalidate because project cb1e2d0dea2c4829af1e277fd963c576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:48:09.042531 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:09.043212 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG keystone.notifications [None req-7702f8fc-299c-404c-9726-facf5959cddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:09.044927 dv-cinder-849690-2-smb devstack@keystone.service[80225]: [pid: 80225|app: 0|req: 1449/2927] 10.222.0.57 () {58 vars in 1232 bytes} [Fri Jul 15 19:48:08 2022] DELETE /identity/v3/projects/cb1e2d0dea2c4829af1e277fd963c576 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:48:18.699449 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:19.039559 dv-cinder-849690-2-smb devstack@keystone.service[80225]: DEBUG dbcounter [-] [80225] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:49:06.830815 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:49:06.832498 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:49:06.991409 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69b94-476d-4ddc-8fd2-520b9f9e9c4e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:49:07.059487 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0768be15edd043a6a24a14d023baff4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02824b2f4461499a890e7c6fa127ed61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:49:07.060314 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:49:07.060635 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:49:07.061025 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:49:07.064398 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:49:07.083285 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:49:07.085666 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5a100-31e8-41d2-b92a-b6975627c37c service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:49:07.099814 dv-cinder-849690-2-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1479/2928] 10.222.0.57 () {60 vars in 1365 bytes} [Fri Jul 15 19:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:49:17.095315 dv-cinder-849690-2-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}